Jul 30 22:38:14.572121 ip-10-0-143-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 22:38:14.572133 ip-10-0-143-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 22:38:14.572143 ip-10-0-143-234 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 22:38:14.572452 ip-10-0-143-234 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 22:38:24.576535 ip-10-0-143-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 22:38:24.576564 ip-10-0-143-234 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8d70042046e44ff3806e653218101455 --
Jul 30 22:40:18.608392 ip-10-0-143-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 22:40:19.025270 ip-10-0-143-234 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:19.025270 ip-10-0-143-234 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 22:40:19.025270 ip-10-0-143-234 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:19.025270 ip-10-0-143-234 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 22:40:19.025270 ip-10-0-143-234 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:40:19.026431 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.026337    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 22:40:19.030080 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030065    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030083    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030088    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030106    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030109    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030112    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030115    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030118    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030121    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030124    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030127    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030131    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.030135 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030134    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030142    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030146    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030149    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030151    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030154    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030156    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030159    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030161    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030164    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030168    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030171    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030175    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030178    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030181    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030184    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030187    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030190    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030192    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.030441 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030194    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030197    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030199    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030202    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030204    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030207    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030209    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030212    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030215    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030217    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030219    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030222    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030224    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030226    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030229    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030232    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030235    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030237    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030240    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030242    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.030882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030245    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030247    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030249    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030251    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030254    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030256    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030259    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030261    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030264    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030266    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030270    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030272    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030275    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030277    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030279    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030282    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030284    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030286    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030289    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030291    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.031412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030294    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030297    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030299    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030301    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030304    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030306    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030308    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030313    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030315    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030318    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030320    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030323    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030325    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030328    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030330    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030333    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030335    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030338    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030340    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030342    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.031871 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030345    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030347    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030350    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030352    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030354    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030357    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030359    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.030361    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031044    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031050    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031053    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031056    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031059    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031062    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031065    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031067    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031070    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031072    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031075    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031078    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.032353 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031081    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031083    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031086    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031089    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031091    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031110    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031112    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031115    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031117    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031120    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031122    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031125    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031127    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031130    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031132    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031135    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031137    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031139    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031142    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031144    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.032822 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031148    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031150    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031153    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031155    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031158    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031160    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031170    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031173    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031176    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031178    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031181    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031184    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031187    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031189    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031192    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031194    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031196    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031199    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031201    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031204    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.033437 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031206    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031209    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031211    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031213    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031216    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031218    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031221    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031223    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031225    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031228    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031230    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031232    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031235    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031237    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031241    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031245    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031248    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031250    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031253    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.033919 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031257    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031262    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031266    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031269    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031272    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031275    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031277    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031280    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031282    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031284    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031287    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031289    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031291    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031293    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031296    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031298    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031301    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031303    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031305    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031308    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.034412 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031310    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031312    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031315    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031317    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031320    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031322    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031325    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031327    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031679    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031684    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031687    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031689    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031692    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031695    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031697    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031701    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031704    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031706    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031709    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031711    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.034872 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031714    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031716    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031719    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031721    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031724    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031726    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031730    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031733    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031736    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031739    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031741    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031743    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031746    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031749    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031751    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031753    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031756    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031758    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031760    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.035438 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031763    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031765    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031767    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031770    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031772    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031775    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031777    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031780    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031783    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031786    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031789    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031791    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031794    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031796    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031798    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031800    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031803    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031805    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031808    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031810    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.035886 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031812    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031815    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031817    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031819    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031822    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031824    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031826    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031829    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031831    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031833    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031836    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031838    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031840    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031843    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031846    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031848    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031851    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031853    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031856    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031859    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031861    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.036399 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031864    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031867    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031869    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031873    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031877    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031879    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031883    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031885    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031888    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031890    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031893    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031896    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031899    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031901    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031904    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031907    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031909    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031912    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031915    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.036898 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031917    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031919    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031921    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031924    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031926    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031928    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031932    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.031935    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032006    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032017    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032024    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032028    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032032    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032036    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032040    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032043    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032046    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032049    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032052    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032056    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032058    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032062    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 30 22:40:19.037391 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032065    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032067    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032070    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032073    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032077    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032080    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032083    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032088    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032091    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032109    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032112    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032115    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032118    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032121    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032124    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032127    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032130    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032133    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032136    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032139    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032142    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032146    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032149    2559 flags.go:64] FLAG: --enable-server="true"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032152    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032156    2559 flags.go:64] FLAG: --event-burst="100"
Jul 30 22:40:19.037906 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032159    2559 flags.go:64] FLAG: --event-qps="50"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032162    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032165    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032168    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032171    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032174    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032177    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032179    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032182    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032185    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032187    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032190    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032193    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032196    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032199    2559 flags.go:64] FLAG: --feature-gates=""
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032203    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032206    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032209    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032212    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032214    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032217    2559 flags.go:64] FLAG: --help="false"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032220    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032223    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032225    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 22:40:19.038521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032228    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032231    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032234    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032237    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032241    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032244    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032246    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032250    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032252    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032255    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032258    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032260    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032264    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032266    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032269    2559 flags.go:64] FLAG: --lock-file=""
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032271    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032274    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032277    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032282    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032284    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032287    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032290    2559 flags.go:64] FLAG: --logging-format="text"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032294    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032297    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 22:40:19.039133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032299    2559 flags.go:64] FLAG: --manifest-url=""
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032302    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032306    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032309    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032313    2559 flags.go:64] FLAG: --max-pods="110"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032315    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032318    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032321    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032324    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032327    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032330    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032333    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032341    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032344    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032347    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032349    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032352    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032358    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032361    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032364    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032367    2559 flags.go:64] FLAG: --port="10250"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032370    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032372    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002437a808d833219"
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032375    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 30 22:40:19.039738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032378    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032381    2559 flags.go:64] FLAG: --register-node="true"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032384    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032387    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032389    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032392    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032396    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032399    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032402    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032405    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032408    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032411    2559 flags.go:64] FLAG: --runonce="false"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032413    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032416    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032419    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032421    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032424    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032426    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032429    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032432    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032435    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032439    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032442    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032444    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032447    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 22:40:19.040314 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032450    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032453    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032458    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032461    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032463    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032467    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032470    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032473    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032475    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032478    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032481    2559 flags.go:64] FLAG: --v="2"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032484    2559 flags.go:64] FLAG: --version="false"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032488    2559 flags.go:64] FLAG: --vmodule=""
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032493    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.032496    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032604    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032607    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032610    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032613    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032616    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032619    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032621    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032624    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.040894 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032626    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032629    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032631    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032633    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032636    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032640    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032642    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032645    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032647    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032649    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032652    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032655    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032657    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032660    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032662    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032665    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032667    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032669    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032672    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032674    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.041482 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032677    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032679    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032683    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032685    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032688    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032690    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032692    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032695    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032698    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032700    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032702    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032705    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032707    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032710    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032712    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032714    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032717    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032720    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032723    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032725    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.041978 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032728    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032730    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032733    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032736    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032738    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032741    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032743    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032745    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032748    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032750    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032752    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032755    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032758    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032760    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032763    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032766    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032769    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032771    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032773    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032776    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.042493 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032779    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032781    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032784    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032786    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032790    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032793    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032796    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032799    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032801    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032805    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032808    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032810    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032813    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032815    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032818    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032820    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032823    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032827    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032831    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.042962 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032834    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032836    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032839    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032842    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032845    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032848    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032850    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032856    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032859    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032861    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032864    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.032866    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.033554    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.040610    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.040624    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 22:40:19.043415 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.041283    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.041291    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041355    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041361    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041365    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041368    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041372    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041376    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041381    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041386    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041391    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041395    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041397    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041401    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041404    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041407    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041410    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041412    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041415    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.043918 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041417    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041420    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041422    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041425    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041427    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041430    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041433    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041435    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041438    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041440    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041443    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041446    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041449    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041451    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041454    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041458    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041465    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041472    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041477    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.044638 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041480    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041483    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041486    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041489    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041492    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041495    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041497    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041500    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041502    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041506    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041509    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041511    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041514    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041517    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041519    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041521    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041524    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041526    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041529    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041533    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.045118 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041536    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041540    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041544    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041549    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041554    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041559    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041562    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041564    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041567    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041569    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041571    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041574    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041576    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041579    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041581    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041584    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041586    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041589    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041591    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041594    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.045662 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041597    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041600    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041603    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041606    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041608    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041611    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041613    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041615    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041618    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041621    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041626    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041630    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041634    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041638    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041641    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041643    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041646    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041649    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041652    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041654    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.046274 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041657    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041659    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041663    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.041669    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041797    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041804    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041808    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041811    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041814    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041817    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041819    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041822    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041825    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041829    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:40:19.046783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041832    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041835    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041838    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041840    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041843    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041845    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041847    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041850    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041853    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041855    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041858    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041860    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041863    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041867    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041871    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041875    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041879    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041884    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041886    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:40:19.047136 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041889    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041893    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041896    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041899    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041902    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041904    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041907    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041909    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041912    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041915    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041917    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041919    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041922    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041924    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041927    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041930    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041932    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041935    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041937    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:40:19.047588 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041940    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041942    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041945    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041948    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041953    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041957    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041961    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041965    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041968    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041970    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041973    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041975    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041977    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041980    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041983    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041985    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041988    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041990    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041993    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041995    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:40:19.048032 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.041998    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042000    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042002    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042005    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042007    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042009    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042012    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042014    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042016    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042019    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042022    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042024    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042027    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042032    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042036    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042042    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042046    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042050    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042053    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042056    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:40:19.048501 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042059    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042062    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042064    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042066    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042069    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042071    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042074    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042076    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042078    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042081    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:19.042083    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.042088    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.042215    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.046910    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 22:40:19.048990 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.048222    2559 server.go:1019] "Starting client certificate rotation"
Jul 30 22:40:19.049372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.048315    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:40:19.049372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.048355    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:40:19.051313 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.051299    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:40:19.052395 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.052380    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:40:19.062464 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.062447    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 30 22:40:19.064535 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.064519    2559 log.go:25] "Validated CRI v1 image API"
Jul 30 22:40:19.066180 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.066160    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 22:40:19.068673 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.068656    2559 fs.go:135] Filesystem UUIDs: map[5b333c6f-0be4-4913-82f9-e85ea315afff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dcd21409-7aeb-433a-ac83-85e032ab8484:/dev/nvme0n1p4]
Jul 30 22:40:19.068743 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.068674    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 22:40:19.074975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.074855    2559 manager.go:216] Machine: {Timestamp:2026-07-30 22:40:19.073551425 +0000 UTC m=+0.338797354 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197305 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28341d2e96bcc5f8dc451e27581b76 SystemUUID:ec28341d-2e96-bcc5-f8dc-451e27581b76 BootID:8d700420-46e4-4ff3-806e-653218101455 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:9d:8f:f3:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:9d:8f:f3:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:07:6c:1d:4c:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 22:40:19.074975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.074961    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 22:40:19.075168 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.075062    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 22:40:19.077045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.077027    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:40:19.077807 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.077776    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 22:40:19.077968 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.077813    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 22:40:19.078565 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.078553    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 22:40:19.078616 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.078570    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 22:40:19.078616 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.078581    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:40:19.079356 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.079344    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:40:19.080180 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.080168    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 22:40:19.083184 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083171    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:40:19.083323 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083311    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 22:40:19.083385 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083349    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 22:40:19.083385 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083371    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 22:40:19.083474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083390    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 22:40:19.083474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083402    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 30 22:40:19.083474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.083417    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 22:40:19.084459 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.084441    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:40:19.084580 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.084471    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:40:19.086992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.086975    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 22:40:19.088237 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.088221    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 22:40:19.088322 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.088259    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 22:40:19.089406 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089389    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089411    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089421    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089432    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089444    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089453    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089464    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 22:40:19.089473 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089472    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 22:40:19.089668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089481    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 22:40:19.089668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089489    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 22:40:19.089668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089512    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 22:40:19.089668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.089519    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 22:40:19.090263 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.090254    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 22:40:19.090295 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.090263    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 22:40:19.093480 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.093465    2559 server.go:1268] "Started kubelet"
Jul 30 22:40:19.093593 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.093555    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 22:40:19.093786 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.093549    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 22:40:19.094059 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.094038    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 22:40:19.094488 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.094461    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 22:40:19.094488 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.094461    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 22:40:19.094511 ip-10-0-143-234 systemd[1]: Started Kubernetes Kubelet.
Jul 30 22:40:19.094724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.094681    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 22:40:19.095154 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.095115    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 22:40:19.095362 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.095284    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 22:40:19.098501 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.098480    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nsnfh"
Jul 30 22:40:19.098821 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.098801    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 22:40:19.099857 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.099840    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 22:40:19.099857 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.099847    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 22:40:19.099985 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.099948    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.100426 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100410    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 22:40:19.100426 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100424    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 22:40:19.100556 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100411    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 22:40:19.100556 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100543    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 22:40:19.100556 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100550    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 22:40:19.100675 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100624    2559 factory.go:55] Registering systemd factory
Jul 30 22:40:19.100675 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100641    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 30 22:40:19.100938 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100924    2559 factory.go:153] Registering CRI-O factory
Jul 30 22:40:19.101009 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100940    2559 factory.go:223] Registration of the crio container factory successfully
Jul 30 22:40:19.101009 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.100986    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 22:40:19.101009 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.101006    2559 factory.go:103] Registering Raw factory
Jul 30 22:40:19.101169 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.101020    2559 manager.go:1196] Started watching for new ooms in manager
Jul 30 22:40:19.101525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.101511    2559 manager.go:349] Starting recovery of all containers
Jul 30 22:40:19.101586 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.100611    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-234.ec2.internal.18c7326c8dda4981  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-234.ec2.internal,UID:ip-10-0-143-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-234.ec2.internal,},FirstTimestamp:2026-07-30 22:40:19.093440897 +0000 UTC m=+0.358686826,LastTimestamp:2026-07-30 22:40:19.093440897 +0000 UTC m=+0.358686826,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-234.ec2.internal,}"
Jul 30 22:40:19.106312 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.106162    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nsnfh"
Jul 30 22:40:19.108067 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.108039    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 22:40:19.110450 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.110416    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 22:40:19.110541 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.110519    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 22:40:19.113564 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.113422    2559 manager.go:354] Recovery completed
Jul 30 22:40:19.118556 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.118543    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.120386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120369    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.120450 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120406    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.120450 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120420    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.120886 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120872    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 22:40:19.120886 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120884    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 22:40:19.120986 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120897    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:40:19.120986 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.120906    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.121637 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.121622    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.121691 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.121650    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.121691 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.121660    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.122002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.121990    2559 policy_none.go:49] "None policy: Start"
Jul 30 22:40:19.122038 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.122007    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 22:40:19.122038 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.122018    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 22:40:19.122472 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.122369    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-234.ec2.internal.18c7326c8f7577df  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-234.ec2.internal,UID:ip-10-0-143-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-234.ec2.internal,},FirstTimestamp:2026-07-30 22:40:19.120388063 +0000 UTC m=+0.385633999,LastTimestamp:2026-07-30 22:40:19.120388063 +0000 UTC m=+0.385633999,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-234.ec2.internal,}"
Jul 30 22:40:19.123044 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.123033    2559 policy_none.go:47] "Start"
Jul 30 22:40:19.163688 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.163672    2559 manager.go:337] "Starting Device Plugin manager"
Jul 30 22:40:19.163776 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.163703    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 22:40:19.163776 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.163714    2559 server.go:87] "Starting device plugin registration server"
Jul 30 22:40:19.164002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.163989    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 22:40:19.164037 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.164006    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 22:40:19.164124 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.164093    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 22:40:19.164200 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.164188    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 22:40:19.164200 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.164199    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 22:40:19.164728 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.164711    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 22:40:19.164808 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.164753    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.233789 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.233761    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 22:40:19.234803 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.233806    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 22:40:19.234803 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.233829    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 22:40:19.234803 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.233866    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 22:40:19.236307 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.236291    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:19.264264 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.264238    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.265116 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.265086    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.265196 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.265130    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.265196 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.265141    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.265196 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.265166    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.273345 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.273327    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.273442 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.273357    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-234.ec2.internal\": node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.286457 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.286404    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.334854 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.334816    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"]
Jul 30 22:40:19.334977 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.334885    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.336333 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.336318    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.336394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.336354    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.336394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.336365    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.337538 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.337523    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.337659 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.337645    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.337753 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.337700    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.338280 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338261    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.338388 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338292    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.338388 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338303    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.338388 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338261    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.338388 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338371    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.338519 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.338396    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.339438 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.339425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.339491 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.339447    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:40:19.347224 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.347212    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:40:19.347289 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.347236    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:40:19.347289 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.347245    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:40:19.355640 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.355622    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-234.ec2.internal\" not found" node="ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.361068 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.361050    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-234.ec2.internal\" not found" node="ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.387310 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.387296    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.402703 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.402679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d051237fd0551e063798067bc184f11-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"4d051237fd0551e063798067bc184f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.402703 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.402702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.402824 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.402721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.488347 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.488327    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.503705 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d051237fd0551e063798067bc184f11-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"4d051237fd0551e063798067bc184f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.503759 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.503759 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.503819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.503819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d051237fd0551e063798067bc184f11-config\") pod \"kube-apiserver-proxy-ip-10-0-143-234.ec2.internal\" (UID: \"4d051237fd0551e063798067bc184f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.503819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.503792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7860fdb0545b5e81dbdfe848b0faf404-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal\" (UID: \"7860fdb0545b5e81dbdfe848b0faf404\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.589133 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.589059    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.658637 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.658606    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.664011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:19.663986    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:19.689856 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.689831    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.790360 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.790312    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.890930 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.890841    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:19.994160 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:19.994130    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:20.050740 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.050709    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 22:40:20.051282 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.050863    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 22:40:20.095247 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:20.095214    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:20.114232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.114167    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 22:35:19 +0000 UTC" deadline="2028-01-04 06:02:22.45524129 +0000 UTC"
Jul 30 22:40:20.114232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.114224    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12535h22m2.341020992s"
Jul 30 22:40:20.120023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.120007    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:20.195713 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:20.195647    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-234.ec2.internal\" not found"
Jul 30 22:40:20.241153 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:20.241117    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7860fdb0545b5e81dbdfe848b0faf404.slice/crio-7f2020094b3cb7bce45ba0d1aaf7a646c6983c1c1538d78b113484bd8eef0ae7 WatchSource:0}: Error finding container 7f2020094b3cb7bce45ba0d1aaf7a646c6983c1c1538d78b113484bd8eef0ae7: Status 404 returned error can't find the container with id 7f2020094b3cb7bce45ba0d1aaf7a646c6983c1c1538d78b113484bd8eef0ae7
Jul 30 22:40:20.241565 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:20.241545    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d051237fd0551e063798067bc184f11.slice/crio-972e84b322773b610d78c843a5e59475c9cc98ae72e69153810b3ded2792137c WatchSource:0}: Error finding container 972e84b322773b610d78c843a5e59475c9cc98ae72e69153810b3ded2792137c: Status 404 returned error can't find the container with id 972e84b322773b610d78c843a5e59475c9cc98ae72e69153810b3ded2792137c
Jul 30 22:40:20.247972 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.247948    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:40:20.248521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.248495    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:20.301116 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.301081    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:20.314614 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.314585    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:40:20.316834 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.316819    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal"
Jul 30 22:40:20.324683 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.324665    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:40:20.410286 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.410245    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:20.866481 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:20.866300    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:40:21.085517 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.085480    2559 apiserver.go:52] "Watching apiserver"
Jul 30 22:40:21.096000 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.095970    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 22:40:21.096437 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.096410    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mbpsh","kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg","openshift-dns/node-resolver-8t95k","openshift-image-registry/node-ca-xck9c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-ng5lj","openshift-multus/network-metrics-daemon-7dfp9","kube-system/konnectivity-agent-hr8fx","openshift-cluster-node-tuning-operator/tuned-7qk9z","openshift-multus/multus-f62tp","openshift-network-diagnostics/network-check-target-cjcmz","openshift-network-operator/iptables-alerter-hklg6","openshift-ovn-kubernetes/ovnkube-node-s7v5c"]
Jul 30 22:40:21.098738 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.097976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.100317 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.100288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.101098 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.100559    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.101098 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.100844    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 22:40:21.101731 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.101635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.101849 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.101829    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.101988 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.101970    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 22:40:21.102061 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.102053    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 22:40:21.102366 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.102325    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f666g\""
Jul 30 22:40:21.102571 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.102552    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 22:40:21.102809 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.102793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.102898 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.102833    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.103436 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.103415    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.103748 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.103729    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.103872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.103853    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.103942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.103894    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 22:40:21.103942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.103914    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 22:40:21.104290 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.104272    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.104476 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.104447    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b9l5j\""
Jul 30 22:40:21.105108 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zhwpj\""
Jul 30 22:40:21.105344 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105315    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.105487 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.105625 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.105690 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105664    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 22:40:21.105690 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105678    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2hkk\""
Jul 30 22:40:21.106047 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.105992    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.106047 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.106013    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6dsl\""
Jul 30 22:40:21.106272 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.106257    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.106624 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.106608    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.108264 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.108242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.108361 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.108315    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:21.108471 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.108455    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.108603 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.108585    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcqg4\""
Jul 30 22:40:21.109525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.109620 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 22:40:21.109620 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109599    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.109730 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.109626    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:21.109829 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109805    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 22:40:21.109917 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109903    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 22:40:21.109917 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.109908    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 22:40:21.110219 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.110200    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dg88w\""
Jul 30 22:40:21.110293 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.110263    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 22:40:21.110496 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.110479    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 22:40:21.110963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.110944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.113678 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-os-release\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.113762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm28v\" (UniqueName: \"kubernetes.io/projected/9c083178-7fdf-432f-aed2-ca510603fbfa-kube-api-access-zm28v\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.113808 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-hosts-file\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.113808 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-tmp-dir\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.113873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-system-cni-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.113873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-cnibin\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.113873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:40:21.113963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.113963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.114035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.114035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.113998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-host-slash\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.114035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-socket-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-registration-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114215    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxtbt\""
Jul 30 22:40:21.114300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114223    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 22:40:21.114300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-sys-fs\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwk9\" (UniqueName: \"kubernetes.io/projected/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-kube-api-access-cpwk9\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.114453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.114453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfhw\" (UniqueName: \"kubernetes.io/projected/20ef592c-f028-41ec-b869-6495c7a98159-kube-api-access-vkfhw\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.114453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-iptables-alerter-script\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.114661 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97dkf\" (UniqueName: \"kubernetes.io/projected/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-kube-api-access-97dkf\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.114661 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-device-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.114825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.114806    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.116008 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.115412    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:40:21.117042 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.116989    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:21.117271 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.117248    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:21.117376 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.117126    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 22:40:21.117549 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.117418    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r784g\""
Jul 30 22:40:21.142655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.142633    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdjxz"
Jul 30 22:40:21.148948 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.148924    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdjxz"
Jul 30 22:40:21.201896 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.201873    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 22:40:21.214783 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-tmp-dir\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.214897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-etc-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.214897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-bin\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.214897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.214897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-kubelet\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-systemd-units\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.214972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-k8s-cni-cncf-io\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-hostroot\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-serviceca\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-sys\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwk9\" (UniqueName: \"kubernetes.io/projected/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-kube-api-access-cpwk9\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-tmp-dir\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.215148 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-slash\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-ovn\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55896a18-fa3f-46db-b116-fa0c38d12408-ovn-node-metrics-cert\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-cni-binary-copy\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4nr\" (UniqueName: \"kubernetes.io/projected/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-kube-api-access-hv4nr\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-iptables-alerter-script\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-script-lib\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysconfig\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-multus-daemon-config\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-systemd\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-conf-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-cnibin\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-registration-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.215611 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-conf\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-system-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-socket-dir-parent\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-kubelet-config\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfhw\" (UniqueName: \"kubernetes.io/projected/20ef592c-f028-41ec-b869-6495c7a98159-kube-api-access-vkfhw\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-os-release\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215822    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-multus\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-kubelet\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-systemd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sd2l\" (UniqueName: \"kubernetes.io/projected/55896a18-fa3f-46db-b116-fa0c38d12408-kube-api-access-6sd2l\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-modprobe-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-socket-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.215985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-sys-fs\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.216326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-var-lib-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-netd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-lib-modules\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-etc-tuned\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-tmp\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216235    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-socket-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-sys-fs\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216161    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-iptables-alerter-script\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.216967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-registration-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-cnibin\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.217209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217005    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-etc-kubernetes\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea0da7d1-084d-4141-b232-24d31d900c4c-agent-certs\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-dbus\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-device-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-log-socket\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-host\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-device-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-bin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm28v\" (UniqueName: \"kubernetes.io/projected/9c083178-7fdf-432f-aed2-ca510603fbfa-kube-api-access-zm28v\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-config\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea0da7d1-084d-4141-b232-24d31d900c4c-konnectivity-ca\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmpp\" (UniqueName: \"kubernetes.io/projected/de59c87b-7872-423b-bdf2-d6f519e5018a-kube-api-access-dmmpp\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-system-cni-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-system-cni-dir\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.217965 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-host-slash\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlrz\" (UniqueName: \"kubernetes.io/projected/039579c7-9bac-4219-af1c-288f3f633d03-kube-api-access-xzlrz\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217607    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-host-slash\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-cnibin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-host\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-netns\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-node-log\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c083178-7fdf-432f-aed2-ca510603fbfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-var-lib-kubelet\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-netns\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2fh\" (UniqueName: \"kubernetes.io/projected/db9b30f2-a0fe-4989-8752-76e402360862-kube-api-access-bz2fh\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.217976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97dkf\" (UniqueName: \"kubernetes.io/projected/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-kube-api-access-97dkf\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-env-overrides\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.218635 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-multus-certs\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-kubernetes\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-run\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-os-release\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-hosts-file\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20ef592c-f028-41ec-b869-6495c7a98159-os-release\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-hosts-file\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.219152 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.218439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20ef592c-f028-41ec-b869-6495c7a98159-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.222823 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.222800    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 22:40:21.225973 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.225954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfhw\" (UniqueName: \"kubernetes.io/projected/20ef592c-f028-41ec-b869-6495c7a98159-kube-api-access-vkfhw\") pod \"multus-additional-cni-plugins-ng5lj\" (UID: \"20ef592c-f028-41ec-b869-6495c7a98159\") " pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.226169 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.226146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm28v\" (UniqueName: \"kubernetes.io/projected/9c083178-7fdf-432f-aed2-ca510603fbfa-kube-api-access-zm28v\") pod \"aws-ebs-csi-driver-node-lg5xg\" (UID: \"9c083178-7fdf-432f-aed2-ca510603fbfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.226282 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.226148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwk9\" (UniqueName: \"kubernetes.io/projected/e67ebb8c-e370-400c-8b66-01f0dfdaff1d-kube-api-access-cpwk9\") pod \"node-resolver-8t95k\" (UID: \"e67ebb8c-e370-400c-8b66-01f0dfdaff1d\") " pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.226442 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.226422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97dkf\" (UniqueName: \"kubernetes.io/projected/a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a-kube-api-access-97dkf\") pod \"iptables-alerter-hklg6\" (UID: \"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a\") " pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.241566 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.241505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" event={"ID":"4d051237fd0551e063798067bc184f11","Type":"ContainerStarted","Data":"972e84b322773b610d78c843a5e59475c9cc98ae72e69153810b3ded2792137c"}
Jul 30 22:40:21.243091 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.243041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7860fdb0545b5e81dbdfe848b0faf404","Type":"ContainerStarted","Data":"7f2020094b3cb7bce45ba0d1aaf7a646c6983c1c1538d78b113484bd8eef0ae7"}
Jul 30 22:40:21.318620 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-conf\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.318620 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-system-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-socket-dir-parent\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-kubelet-config\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-os-release\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-multus\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-conf\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-kubelet\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-system-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.318841 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.318841    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-multus\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318896    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-os-release\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-kubelet-config\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.318926    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:21.818901507 +0000 UTC m=+3.084147452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-systemd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-socket-dir-parent\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.318987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sd2l\" (UniqueName: \"kubernetes.io/projected/55896a18-fa3f-46db-b116-fa0c38d12408-kube-api-access-6sd2l\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-systemd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-modprobe-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-var-lib-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-kubelet\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-netd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-lib-modules\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-etc-tuned\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-var-lib-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.319386 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-modprobe-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-tmp\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-etc-kubernetes\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-lib-modules\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea0da7d1-084d-4141-b232-24d31d900c4c-agent-certs\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-dbus\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-netd\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319502    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-etc-kubernetes\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-log-socket\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-cni-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319602    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-host\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b764ae7b-67f3-4752-abe4-d930ecc39ffe-dbus\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319717    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.320147 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-log-socket\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.319550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-host\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-bin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-config\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea0da7d1-084d-4141-b232-24d31d900c4c-konnectivity-ca\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-var-lib-cni-bin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmpp\" (UniqueName: \"kubernetes.io/projected/de59c87b-7872-423b-bdf2-d6f519e5018a-kube-api-access-dmmpp\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlrz\" (UniqueName: \"kubernetes.io/projected/039579c7-9bac-4219-af1c-288f3f633d03-kube-api-access-xzlrz\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-cnibin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-host\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-netns\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-node-log\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-var-lib-kubelet\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-netns\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2fh\" (UniqueName: \"kubernetes.io/projected/db9b30f2-a0fe-4989-8752-76e402360862-kube-api-access-bz2fh\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-run-netns\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321045 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-env-overrides\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-multus-certs\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-kubernetes\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-run\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea0da7d1-084d-4141-b232-24d31d900c4c-konnectivity-ca\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-config\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-etc-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-node-log\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-etc-openvswitch\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-cnibin\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-host\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.320975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-bin\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321004    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-var-lib-kubelet\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-kubelet\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysctl-d\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.321037    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-cni-bin\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-systemd-units\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.321963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-systemd-units\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-k8s-cni-cncf-io\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-netns\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.321092    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:21.821073721 +0000 UTC m=+3.086319638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-hostroot\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321137    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-k8s-cni-cncf-io\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-run\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-kubernetes\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-kubelet\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-hostroot\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-serviceca\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-host-run-multus-certs\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-sys\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-sys\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-slash\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-ovn\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55896a18-fa3f-46db-b116-fa0c38d12408-ovn-node-metrics-cert\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.322805 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-cni-binary-copy\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-host-slash\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4nr\" (UniqueName: \"kubernetes.io/projected/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-kube-api-access-hv4nr\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-script-lib\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysconfig\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-env-overrides\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321513    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-multus-daemon-config\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-systemd\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-conf-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db9b30f2-a0fe-4989-8752-76e402360862-multus-conf-dir\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.321769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-serviceca\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-tmp\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55896a18-fa3f-46db-b116-fa0c38d12408-ovnkube-script-lib\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-cni-binary-copy\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322407    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55896a18-fa3f-46db-b116-fa0c38d12408-run-ovn\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322416    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea0da7d1-084d-4141-b232-24d31d900c4c-agent-certs\") pod \"konnectivity-agent-hr8fx\" (UID: \"ea0da7d1-084d-4141-b232-24d31d900c4c\") " pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-systemd\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/039579c7-9bac-4219-af1c-288f3f633d03-etc-sysconfig\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.323411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.322615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db9b30f2-a0fe-4989-8752-76e402360862-multus-daemon-config\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.323935 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.323102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/039579c7-9bac-4219-af1c-288f3f633d03-etc-tuned\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.324879 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.324850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55896a18-fa3f-46db-b116-fa0c38d12408-ovn-node-metrics-cert\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.326532 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.326508    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:21.326532 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.326533    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:21.326653 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.326548    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:21.326653 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.326602    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:21.826585774 +0000 UTC m=+3.091831715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:21.329011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.328992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sd2l\" (UniqueName: \"kubernetes.io/projected/55896a18-fa3f-46db-b116-fa0c38d12408-kube-api-access-6sd2l\") pod \"ovnkube-node-s7v5c\" (UID: \"55896a18-fa3f-46db-b116-fa0c38d12408\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.331920 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.331896    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlrz\" (UniqueName: \"kubernetes.io/projected/039579c7-9bac-4219-af1c-288f3f633d03-kube-api-access-xzlrz\") pod \"tuned-7qk9z\" (UID: \"039579c7-9bac-4219-af1c-288f3f633d03\") " pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.332047 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.331957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmpp\" (UniqueName: \"kubernetes.io/projected/de59c87b-7872-423b-bdf2-d6f519e5018a-kube-api-access-dmmpp\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.334011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.333994    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2fh\" (UniqueName: \"kubernetes.io/projected/db9b30f2-a0fe-4989-8752-76e402360862-kube-api-access-bz2fh\") pod \"multus-f62tp\" (UID: \"db9b30f2-a0fe-4989-8752-76e402360862\") " pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.334091 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.334048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4nr\" (UniqueName: \"kubernetes.io/projected/61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7-kube-api-access-hv4nr\") pod \"node-ca-xck9c\" (UID: \"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7\") " pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.413015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.412922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ng5lj"
Jul 30 22:40:21.424088 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.424062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hklg6"
Jul 30 22:40:21.444270 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.444232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg"
Jul 30 22:40:21.449338 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.449314    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8t95k"
Jul 30 22:40:21.457256 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.457234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xck9c"
Jul 30 22:40:21.465222 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.465194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:21.472063 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.472043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:21.480929 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.480907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qk9z"
Jul 30 22:40:21.488143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.488125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f62tp"
Jul 30 22:40:21.826385 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.826296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:21.826385 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.826351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:21.826584 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.826475    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:21.826584 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.826546    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:22.826529405 +0000 UTC m=+4.091775322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:21.826584 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.826475    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:21.826737 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.826640    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:22.826619944 +0000 UTC m=+4.091865862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:21.927831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:21.927786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:21.927998 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.927970    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:21.927998 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.927994    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:21.928125 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.928005    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:21.928125 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:21.928072    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:22.92805174 +0000 UTC m=+4.193297660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:22.150860 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:22.150817    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:35:21 +0000 UTC" deadline="2028-02-03 08:49:50.184840706 +0000 UTC"
Jul 30 22:40:22.151477 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:22.150852    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13258h9m28.033993814s"
Jul 30 22:40:22.262735 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:22.262660    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c105ca_d0d3_4e8e_a77d_1d9f8b57c59a.slice/crio-c73d5479cdf4e13a3bc1db349ce7177b2ed35a47dc2bbaa3cb56f3db6eeb1298 WatchSource:0}: Error finding container c73d5479cdf4e13a3bc1db349ce7177b2ed35a47dc2bbaa3cb56f3db6eeb1298: Status 404 returned error can't find the container with id c73d5479cdf4e13a3bc1db349ce7177b2ed35a47dc2bbaa3cb56f3db6eeb1298
Jul 30 22:40:22.265266 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:22.265239    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c083178_7fdf_432f_aed2_ca510603fbfa.slice/crio-62634279f3159231f816d05f7263afd22ee54c653a1836569e2980bc14fcd406 WatchSource:0}: Error finding container 62634279f3159231f816d05f7263afd22ee54c653a1836569e2980bc14fcd406: Status 404 returned error can't find the container with id 62634279f3159231f816d05f7263afd22ee54c653a1836569e2980bc14fcd406
Jul 30 22:40:22.266882 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:22.266811    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0da7d1_084d_4141_b232_24d31d900c4c.slice/crio-4f6aaa87685b2d3571824c10076897626d47f079cb01389870635ec5f9248d13 WatchSource:0}: Error finding container 4f6aaa87685b2d3571824c10076897626d47f079cb01389870635ec5f9248d13: Status 404 returned error can't find the container with id 4f6aaa87685b2d3571824c10076897626d47f079cb01389870635ec5f9248d13
Jul 30 22:40:22.275542 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:40:22.275064    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ef592c_f028_41ec_b869_6495c7a98159.slice/crio-8370d5141c1e0934bae92b8186b7f2d0f840ed812b1156538fc870699c3ad022 WatchSource:0}: Error finding container 8370d5141c1e0934bae92b8186b7f2d0f840ed812b1156538fc870699c3ad022: Status 404 returned error can't find the container with id 8370d5141c1e0934bae92b8186b7f2d0f840ed812b1156538fc870699c3ad022
Jul 30 22:40:22.836132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:22.835799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:22.836317 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:22.836141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:22.836379 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.836333    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:22.836433 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.836405    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:24.836383059 +0000 UTC m=+6.101628990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:22.836508 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.836442    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:22.836508 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.836492    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:24.836478951 +0000 UTC m=+6.101724877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:22.937447 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:22.937401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:22.937632 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.937586    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:22.937632 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.937608    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:22.937632 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.937621    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:22.937796 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:22.937685    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:24.937664531 +0000 UTC m=+6.202910453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:23.151542 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.151429    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:35:21 +0000 UTC" deadline="2028-04-04 17:29:29.042244392 +0000 UTC"
Jul 30 22:40:23.151542 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.151495    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14730h49m5.890753747s"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.237728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:23.237861    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.238342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:23.238452    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.238516    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:23.244237 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:23.238586    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:23.267209 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.267170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" event={"ID":"4d051237fd0551e063798067bc184f11","Type":"ContainerStarted","Data":"6ae950a4d7eeda46c0173275c5aead0dbe6433bb12049a1136157696ff8c85b3"}
Jul 30 22:40:23.278995 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.278916    2559 generic.go:356] "Generic (PLEG): container finished" podID="7860fdb0545b5e81dbdfe848b0faf404" containerID="59bf3f5dab64386149943120351fb6e376fa568f6a9fbc38143f8d3f22efbc89" exitCode=0
Jul 30 22:40:23.279160 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.279017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7860fdb0545b5e81dbdfe848b0faf404","Type":"ContainerDied","Data":"59bf3f5dab64386149943120351fb6e376fa568f6a9fbc38143f8d3f22efbc89"}
Jul 30 22:40:23.283882 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.283659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-234.ec2.internal" podStartSLOduration=3.283639538 podStartE2EDuration="3.283639538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:23.282856958 +0000 UTC m=+4.548102919" watchObservedRunningTime="2026-07-30 22:40:23.283639538 +0000 UTC m=+4.548885479"
Jul 30 22:40:23.301251 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.301169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f62tp" event={"ID":"db9b30f2-a0fe-4989-8752-76e402360862","Type":"ContainerStarted","Data":"e38af631d55153c14433ca6035c5e8b1af37deba531ede62a8f87b5b4b9ef6ed"}
Jul 30 22:40:23.307347 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.307238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"acbf9d791df5932119a0f7a179520b4f05248776e71f5edb4c34e345341cd255"}
Jul 30 22:40:23.317023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.316991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qk9z" event={"ID":"039579c7-9bac-4219-af1c-288f3f633d03","Type":"ContainerStarted","Data":"2389c95dcd6d4792c75904883793a5681e119ca1924b2746a37f52f03d153241"}
Jul 30 22:40:23.329343 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.329300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8t95k" event={"ID":"e67ebb8c-e370-400c-8b66-01f0dfdaff1d","Type":"ContainerStarted","Data":"c853586cce715c0fb7c403c491523491e1d29763bf18aa818e00fca96814ae00"}
Jul 30 22:40:23.350737 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.350520    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr8fx" event={"ID":"ea0da7d1-084d-4141-b232-24d31d900c4c","Type":"ContainerStarted","Data":"4f6aaa87685b2d3571824c10076897626d47f079cb01389870635ec5f9248d13"}
Jul 30 22:40:23.362322 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.362288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xck9c" event={"ID":"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7","Type":"ContainerStarted","Data":"7f293080a3be0d094b6566a685f8a7f784e80901edc1cf110acab5255f7b00eb"}
Jul 30 22:40:23.384937 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.384878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerStarted","Data":"8370d5141c1e0934bae92b8186b7f2d0f840ed812b1156538fc870699c3ad022"}
Jul 30 22:40:23.393953 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.393832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg" event={"ID":"9c083178-7fdf-432f-aed2-ca510603fbfa","Type":"ContainerStarted","Data":"62634279f3159231f816d05f7263afd22ee54c653a1836569e2980bc14fcd406"}
Jul 30 22:40:23.397520 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:23.397418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hklg6" event={"ID":"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a","Type":"ContainerStarted","Data":"c73d5479cdf4e13a3bc1db349ce7177b2ed35a47dc2bbaa3cb56f3db6eeb1298"}
Jul 30 22:40:24.421069 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:24.420753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" event={"ID":"7860fdb0545b5e81dbdfe848b0faf404","Type":"ContainerStarted","Data":"6266c49a3b0280ba6602523346443b710c35eac8417d25a7992ec105387a2bd6"}
Jul 30 22:40:24.854023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:24.853923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:24.854023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:24.854015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:24.854260 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.854167    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:24.854260 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.854232    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:28.854214157 +0000 UTC m=+10.119460081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:24.854677 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.854656    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:24.854788 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.854715    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:28.854698937 +0000 UTC m=+10.119944858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:24.954713 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:24.954646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:24.954977 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.954870    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:24.954977 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.954891    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:24.954977 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.954904    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:24.954977 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:24.954970    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:28.95494901 +0000 UTC m=+10.220194932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:25.236919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:25.237052    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:25.237130    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:25.237238    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:25.237290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:25.237829 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:25.237356    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:27.236373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:27.236293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:27.236373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:27.236325    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:27.236869 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:27.236426    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:27.236869 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:27.236529    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:27.236869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:27.236599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:27.236869 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:27.236685    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:28.900470 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:28.900432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:28.901045 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:28.900623    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:28.901179 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:28.901148    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:28.901238 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:28.901155    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:36.901126916 +0000 UTC m=+18.166372851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:28.901238 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:28.901215    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:36.901204286 +0000 UTC m=+18.166450202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:28.901238 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:28.901026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:29.002956 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:29.002461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:29.002956 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.002609    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:29.002956 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.002623    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:29.002956 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.002632    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:29.002956 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.002677    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:37.002665342 +0000 UTC m=+18.267911258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:29.236207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:29.236218    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.236311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.236365    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:29.236473    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:29.236742 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:29.236620    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:31.234140 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:31.234086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:31.234140 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:31.234138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:31.234645 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:31.234209    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:31.234645 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:31.234292    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:31.234645 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:31.234311    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:31.234645 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:31.234439    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:33.234975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:33.234939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:33.234975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:33.234969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:33.235353 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:33.234939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:33.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:33.235061    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:33.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:33.235142    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:33.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:33.235198    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:35.237142 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:35.237091    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:35.237142 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:35.237147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:35.237569 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:35.237147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:35.237569 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:35.237223    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:35.237569 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:35.237329    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:35.237569 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:35.237379    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:36.962859 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:36.962818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:36.963360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:36.962883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:36.963360 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:36.962999    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:36.963360 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:36.963004    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:36.963360 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:36.963069    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:40:52.963049018 +0000 UTC m=+34.228294935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:36.963360 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:36.963089    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:40:52.963080405 +0000 UTC m=+34.228326321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:37.063241 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:37.063208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:37.063409 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.063334    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:37.063409 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.063351    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:37.063409 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.063360    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:37.063541 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.063413    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:40:53.063396918 +0000 UTC m=+34.328642836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:37.234301 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:37.234274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:37.234421 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:37.234287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:37.234421 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:37.234388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:37.234421 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.234396    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:37.234573 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.234479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:37.234573 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:37.234557    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:39.235282 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:39.235247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:39.235707 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:39.235315    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:39.235707 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:39.235349    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:39.235707 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:39.235432    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:39.235707 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:39.235452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:39.235707 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:39.235567    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:41.234912 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.234875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:41.234912 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.234901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:41.235353 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.234878    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:41.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:41.235005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:41.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:41.235058    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:41.235353 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:41.235120    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:41.471837 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.470990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qk9z" event={"ID":"039579c7-9bac-4219-af1c-288f3f633d03","Type":"ContainerStarted","Data":"725fc929a8bde8ffefee9feae428c22e21f2f582f167af0ff568854e572d6aac"}
Jul 30 22:40:41.488919 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.488797    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-234.ec2.internal" podStartSLOduration=21.488782139 podStartE2EDuration="21.488782139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:24.438863803 +0000 UTC m=+5.704109743" watchObservedRunningTime="2026-07-30 22:40:41.488782139 +0000 UTC m=+22.754028076"
Jul 30 22:40:41.489057 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.489032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7qk9z" podStartSLOduration=3.484055747 podStartE2EDuration="22.489020042s" totalImagesPullingTime="19.004964295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:41.487471948 +0000 UTC m=+22.752717883" watchObservedRunningTime="2026-07-30 22:40:41.489020042 +0000 UTC m=+22.754265972"
Jul 30 22:40:41.504190 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:41.503716    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hr8fx" podStartSLOduration=3.6792637040000002 podStartE2EDuration="22.503695535s" totalImagesPullingTime="18.824431831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:41.503295649 +0000 UTC m=+22.768541587" watchObservedRunningTime="2026-07-30 22:40:41.503695535 +0000 UTC m=+22.768941472"
Jul 30 22:40:42.021276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.021089    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:42.021654 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.021626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:42.036009 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.035960    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xck9c" podStartSLOduration=4.027309184 podStartE2EDuration="23.035946236s" totalImagesPullingTime="19.008637052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:41.523199127 +0000 UTC m=+22.788445065" watchObservedRunningTime="2026-07-30 22:40:42.035946236 +0000 UTC m=+23.301192175"
Jul 30 22:40:42.485927 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.485886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8t95k" event={"ID":"e67ebb8c-e370-400c-8b66-01f0dfdaff1d","Type":"ContainerStarted","Data":"24dd2a7e67caca7b41509311fe416259f65b3f8a6713c2b61101e74d4426b507"}
Jul 30 22:40:42.487434 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.487413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr8fx" event={"ID":"ea0da7d1-084d-4141-b232-24d31d900c4c","Type":"ContainerStarted","Data":"4712cdb807b554adbd6cc6ef7944821392818234b8f8fdf17e8e5b36e334649c"}
Jul 30 22:40:42.488606 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.488588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xck9c" event={"ID":"61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7","Type":"ContainerStarted","Data":"e83baa29725e3c8cfa5d7ae71b6b6811fcd8a20f7e6f62d59c1ac1ee7009364b"}
Jul 30 22:40:42.489873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.489854    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="4ec342a3dab32ebc145aed3e5a7cdfa19ee15fb258f18ab3faf2b79f3c0da695" exitCode=0
Jul 30 22:40:42.489931 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.489898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"4ec342a3dab32ebc145aed3e5a7cdfa19ee15fb258f18ab3faf2b79f3c0da695"}
Jul 30 22:40:42.491689 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.491669    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg" event={"ID":"9c083178-7fdf-432f-aed2-ca510603fbfa","Type":"ContainerStarted","Data":"14a9c4ca99ce76fd7509896a382cf39a3dc807abc50be64a130dc2fb7a834d96"}
Jul 30 22:40:42.493277 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.493250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f62tp" event={"ID":"db9b30f2-a0fe-4989-8752-76e402360862","Type":"ContainerStarted","Data":"25ff6130f0b8cede95f9a9731c908e92185a281e339dec9fdfe87458b5992bbb"}
Jul 30 22:40:42.496041 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"d2f70df59d0991d190e23032778ea315db8f93a4395fee8d08253a8d1fb23bee"}
Jul 30 22:40:42.496138 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"39e3c659a5df289bcd96b5b6c2defda3f3841421eb141ae3034fd2ce6b3152f5"}
Jul 30 22:40:42.496189 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"57098610ecceabc10a23e1bf8392ec9662d8c140f36720cd0801fd68a0c1a440"}
Jul 30 22:40:42.496226 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"0d2f5ba0b3bd035aed9c327e6e1bf5c8305ad04fd5dac6d2520659bfe450bd37"}
Jul 30 22:40:42.496267 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"8e357672daedbd8724b8b56b7d839f8b9440a8314caecf64087d801a6f258b2e"}
Jul 30 22:40:42.496299 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.496269    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"f09b07594ff6521583625dcd9cccb3f439e958dde58b1ed1724a12c32b6e354d"}
Jul 30 22:40:42.517302 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.517260    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8t95k" podStartSLOduration=4.498595341 podStartE2EDuration="23.517248715s" totalImagesPullingTime="19.018653374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:42.516477282 +0000 UTC m=+23.781723218" watchObservedRunningTime="2026-07-30 22:40:42.517248715 +0000 UTC m=+23.782494653"
Jul 30 22:40:42.563055 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.563009    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f62tp" podStartSLOduration=4.50456205 podStartE2EDuration="23.562995694s" totalImagesPullingTime="19.058433644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:42.562497117 +0000 UTC m=+23.827743053" watchObservedRunningTime="2026-07-30 22:40:42.562995694 +0000 UTC m=+23.828241631"
Jul 30 22:40:42.912668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:42.912646    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 22:40:43.177248 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.177076    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T22:40:42.912663538Z","UUID":"99294c40-5799-4a69-be6f-cc75c9833fc4","Handler":null,"Name":"","Endpoint":""}
Jul 30 22:40:43.178827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.178686    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 22:40:43.178827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.178729    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 22:40:43.234806 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.234768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:43.234952 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.234774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:43.234952 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.234815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:43.234952 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:43.234894    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:43.235131 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:43.235061    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:43.235202 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:43.235172    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:43.500988 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.500900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg" event={"ID":"9c083178-7fdf-432f-aed2-ca510603fbfa","Type":"ContainerStarted","Data":"62b7acb8e074fb086b8cf485e9fc2565eea77909162cb24dde97d05b9bc05790"}
Jul 30 22:40:43.504614 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.504153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hklg6" event={"ID":"a3c105ca-d0d3-4e8e-a77d-1d9f8b57c59a","Type":"ContainerStarted","Data":"55c3d00a219092c278d191c43d6f204e93be1908d904ba7f3d1870bc1650dc00"}
Jul 30 22:40:43.504614 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.504356    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 22:40:43.521220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:43.521179    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hklg6" podStartSLOduration=5.489151763 podStartE2EDuration="24.521165357s" totalImagesPullingTime="19.032013594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:43.520924182 +0000 UTC m=+24.786170122" watchObservedRunningTime="2026-07-30 22:40:43.521165357 +0000 UTC m=+24.786411295"
Jul 30 22:40:44.508453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:44.508238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg" event={"ID":"9c083178-7fdf-432f-aed2-ca510603fbfa","Type":"ContainerStarted","Data":"95c5c720d0a91bcd43624d26b5ba64c503616486576512f4eed449d8d6393ec2"}
Jul 30 22:40:44.512224 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:44.512194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"0b959b4475318f07c08d881623a4096cd8724dca529415094597a3d82170313d"}
Jul 30 22:40:44.525037 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:44.524995    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg5xg" podStartSLOduration=3.836095469 podStartE2EDuration="25.524979937s" totalImagesPullingTime="21.688884468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:44.524524334 +0000 UTC m=+25.789770273" watchObservedRunningTime="2026-07-30 22:40:44.524979937 +0000 UTC m=+25.790225875"
Jul 30 22:40:45.234442 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:45.234414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:45.234630 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:45.234414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:45.234630 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:45.234513    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:45.234630 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:45.234596    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:45.234630 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:45.234414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:45.234851 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:45.234672    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:47.234507 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:47.234421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:47.234507 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:47.234454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:47.235164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:47.234421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:47.235164 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:47.234545    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:47.235164 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:47.234624    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:47.235164 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:47.234736    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:48.521792 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.521619    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="3374d8d3719a260b54f5bb39fed8aa4ff834baec0c16b030ca1f500014e7e1d5" exitCode=0
Jul 30 22:40:48.522476 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.521711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"3374d8d3719a260b54f5bb39fed8aa4ff834baec0c16b030ca1f500014e7e1d5"}
Jul 30 22:40:48.525547 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.525528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" event={"ID":"55896a18-fa3f-46db-b116-fa0c38d12408","Type":"ContainerStarted","Data":"749f0684624a8225508b8faeadf293821441696bf0a9c7afc2a9e28cbb2bf18f"}
Jul 30 22:40:48.525843 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.525825    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:48.541789 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.541772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:48.566533 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:48.566494    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c" podStartSLOduration=10.491588183 podStartE2EDuration="29.566481582s" totalImagesPullingTime="19.074893399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:48.564842678 +0000 UTC m=+29.830088616" watchObservedRunningTime="2026-07-30 22:40:48.566481582 +0000 UTC m=+29.831727519"
Jul 30 22:40:49.235163 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.235067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:49.235453 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.235310    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:49.235453 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.235399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:49.235453 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.235460    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:49.235791 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.235756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:49.236416 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.236374    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:49.509670 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.509593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjcmz"]
Jul 30 22:40:49.513609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.513559    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dfp9"]
Jul 30 22:40:49.520630 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.520603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbpsh"]
Jul 30 22:40:49.527721 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.527697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:49.527721 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.527708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.527708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.527818    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.527896    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:49.527956    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.527971    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:49.528285 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.528253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:49.544887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.544862    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:40:49.917605 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.917375    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:49.917761 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.917741    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 22:40:49.918042 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:49.918023    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hr8fx"
Jul 30 22:40:50.532300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:50.532212    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="a1d9c824e5766b7def493f32a3d91c017503fa12fc35f9f0b085e2c7ffe2da68" exitCode=0
Jul 30 22:40:50.532300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:50.532290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"a1d9c824e5766b7def493f32a3d91c017503fa12fc35f9f0b085e2c7ffe2da68"}
Jul 30 22:40:51.234552 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:51.234517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:51.234708 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:51.234529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:51.234708 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:51.234628    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:51.234777 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:51.234729    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:51.234777 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:51.234529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:51.234898 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:51.234846    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:51.772889 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:51.772866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8t95k_e67ebb8c-e370-400c-8b66-01f0dfdaff1d/dns-node-resolver/0.log"
Jul 30 22:40:52.538690 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:52.538607    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="72d49749b0d7662ea06f6b70dca801beaf0a8810155a1324d31506dd9401565c" exitCode=0
Jul 30 22:40:52.538690 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:52.538646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"72d49749b0d7662ea06f6b70dca801beaf0a8810155a1324d31506dd9401565c"}
Jul 30 22:40:52.978655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:52.978574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:52.978655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:52.978638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:52.979065 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:52.978723    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:52.979065 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:52.978747    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:52.979065 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:52.978782    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret podName:b764ae7b-67f3-4752-abe4-d930ecc39ffe nodeName:}" failed. No retries permitted until 2026-07-30 22:41:24.978767767 +0000 UTC m=+66.244013682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret") pod "global-pull-secret-syncer-mbpsh" (UID: "b764ae7b-67f3-4752-abe4-d930ecc39ffe") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:40:52.979065 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:52.978804    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs podName:de59c87b-7872-423b-bdf2-d6f519e5018a nodeName:}" failed. No retries permitted until 2026-07-30 22:41:24.978793088 +0000 UTC m=+66.244039007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs") pod "network-metrics-daemon-7dfp9" (UID: "de59c87b-7872-423b-bdf2-d6f519e5018a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:40:53.079455 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:53.079425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:53.079644 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.079550    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:40:53.079644 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.079572    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:40:53.079644 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.079584    2559 projected.go:196] Error preparing data for projected volume kube-api-access-9cbwq for pod openshift-network-diagnostics/network-check-target-cjcmz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:53.079644 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.079629    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq podName:6b97aaf5-0ba3-47e5-a5df-a28e91daa412 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:25.079616772 +0000 UTC m=+66.344862687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cbwq" (UniqueName: "kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq") pod "network-check-target-cjcmz" (UID: "6b97aaf5-0ba3-47e5-a5df-a28e91daa412") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:40:53.145332 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:53.145299    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xck9c_61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7/node-ca/0.log"
Jul 30 22:40:53.235109 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:53.235062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:53.235290 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:53.235062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:53.235290 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.235207    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dfp9" podUID="de59c87b-7872-423b-bdf2-d6f519e5018a"
Jul 30 22:40:53.235290 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.235242    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjcmz" podUID="6b97aaf5-0ba3-47e5-a5df-a28e91daa412"
Jul 30 22:40:53.235290 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:53.235063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:53.235493 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:40:53.235314    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbpsh" podUID="b764ae7b-67f3-4752-abe4-d930ecc39ffe"
Jul 30 22:40:54.084048 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:54.083972    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-234.ec2.internal" event="NodeReady"
Jul 30 22:40:54.084645 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:54.084148    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 22:40:55.234392 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.234351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:40:55.234960 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.234351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:40:55.234960 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.234351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:40:55.237025 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.236998    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:40:55.237191 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.237051    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 22:40:55.238702 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.238287    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-29hrf\""
Jul 30 22:40:55.238702 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.238352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzp2k\""
Jul 30 22:40:55.238702 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.238422    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 22:40:55.238702 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:55.238562    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:40:56.551441 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:56.551406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerStarted","Data":"b322d84d2c3711174e7ff20d8fa0c309f1e24563a0dd95244291c48e932ddc41"}
Jul 30 22:40:57.557137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:57.556871    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="b322d84d2c3711174e7ff20d8fa0c309f1e24563a0dd95244291c48e932ddc41" exitCode=0
Jul 30 22:40:57.557560 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:57.556931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"b322d84d2c3711174e7ff20d8fa0c309f1e24563a0dd95244291c48e932ddc41"}
Jul 30 22:40:58.562801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:58.562767    2559 generic.go:356] "Generic (PLEG): container finished" podID="20ef592c-f028-41ec-b869-6495c7a98159" containerID="3a649e8f6aad9f8141778cd996505f26753bb954c8c6077afa5e429fad6c2b3e" exitCode=0
Jul 30 22:40:58.563216 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:58.562819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerDied","Data":"3a649e8f6aad9f8141778cd996505f26753bb954c8c6077afa5e429fad6c2b3e"}
Jul 30 22:40:59.568338 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:59.568306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" event={"ID":"20ef592c-f028-41ec-b869-6495c7a98159","Type":"ContainerStarted","Data":"db0db4aa47a1ab7e3f871c4676aed6a90d5277cd8777b6b173008aeb585e02a1"}
Jul 30 22:40:59.593806 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:40:59.593763    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ng5lj" podStartSLOduration=10.292858788 podStartE2EDuration="40.593750215s" totalImagesPullingTime="30.300891427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:40:59.591955737 +0000 UTC m=+40.857201672" watchObservedRunningTime="2026-07-30 22:40:59.593750215 +0000 UTC m=+40.858996151"
Jul 30 22:41:14.968508 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.968473    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8c6b6f849-g8r6c"]
Jul 30 22:41:14.970370 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.970354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:14.973309 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.973279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 22:41:14.973487 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.973467    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 22:41:14.973584 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.973565    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f59gl\""
Jul 30 22:41:14.974751 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.974736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 22:41:14.978180 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.978164    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 22:41:14.987295 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.987273    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sb8tp"]
Jul 30 22:41:14.989330 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.989313    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8c6b6f849-g8r6c"]
Jul 30 22:41:14.989420 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.989393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:14.990745 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.990724    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hl2st"]
Jul 30 22:41:14.992874 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.992856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:14.993050 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.993035    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-npr54\""
Jul 30 22:41:14.993149 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.993063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 22:41:14.993149 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.993041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 22:41:14.993303 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.993287    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 22:41:14.996172 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.996151    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 22:41:14.996424 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.996393    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 22:41:14.996778 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.996761    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 22:41:14.997908 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:14.997884    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 22:41:15.002831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.002811    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9dd4c\""
Jul 30 22:41:15.005562 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.005539    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8c6b6f849-g8r6c"]
Jul 30 22:41:15.005761 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:15.005737    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-hgqtc registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-hgqtc registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c" podUID="f180f023-8508-40fe-90ee-3acaf8eda0e2"
Jul 30 22:41:15.006022 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.006003    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sb8tp"]
Jul 30 22:41:15.008091 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.008074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl2st"]
Jul 30 22:41:15.035992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.035967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-crio-socket\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tqb\" (UniqueName: \"kubernetes.io/projected/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-api-access-84tqb\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0662dea7-b993-483c-873d-0c6ffc667327-cert\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4qw\" (UniqueName: \"kubernetes.io/projected/0662dea7-b993-483c-873d-0c6ffc667327-kube-api-access-gx4qw\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036164 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqtc\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-data-volume\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.036407 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.036318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.127010 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.126971    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"]
Jul 30 22:41:15.129084 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.129059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.136642 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4qw\" (UniqueName: \"kubernetes.io/projected/0662dea7-b993-483c-873d-0c6ffc667327-kube-api-access-gx4qw\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.136765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.136765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqtc\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.136765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.136980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.136980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.136980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-data-volume\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.136980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.136980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.136974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-crio-socket\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tqb\" (UniqueName: \"kubernetes.io/projected/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-api-access-84tqb\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.137240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0662dea7-b993-483c-873d-0c6ffc667327-cert\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.137505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-data-volume\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.137505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.137591 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.137666 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.137718 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.137648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-crio-socket\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.138112 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.138069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.141272 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.141251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.141461 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.141438    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.141502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.141460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.141502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.141489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.141502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.141495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0662dea7-b993-483c-873d-0c6ffc667327-cert\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.151912 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.151893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 22:41:15.163038 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.163017    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 30 22:41:15.163549 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.163531    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 22:41:15.164174 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.164159    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 22:41:15.168340 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.168313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqtc\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.171192 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.171173    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-77f27"]
Jul 30 22:41:15.173848 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.173828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tqb\" (UniqueName: \"kubernetes.io/projected/1ec5a8da-0990-4c50-afc0-f37c77b49d3e-kube-api-access-84tqb\") pod \"insights-runtime-extractor-hl2st\" (UID: \"1ec5a8da-0990-4c50-afc0-f37c77b49d3e\") " pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.173956 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.173941    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.174360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.174342    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4qw\" (UniqueName: \"kubernetes.io/projected/0662dea7-b993-483c-873d-0c6ffc667327-kube-api-access-gx4qw\") pod \"ingress-canary-sb8tp\" (UID: \"0662dea7-b993-483c-873d-0c6ffc667327\") " pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.177464 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.177015    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cqmw\""
Jul 30 22:41:15.177464 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.177255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 22:41:15.177776 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.177759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token\") pod \"image-registry-8c6b6f849-g8r6c\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") " pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.179896 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.179868    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 22:41:15.180426 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.180403    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"]
Jul 30 22:41:15.197051 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.197028    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-77f27"]
Jul 30 22:41:15.237577 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-tmp\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.237577 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgnld\" (UniqueName: \"kubernetes.io/projected/28888643-211e-4cbf-aa44-6dcbb5d47646-kube-api-access-hgnld\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.237780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28888643-211e-4cbf-aa44-6dcbb5d47646-metrics-tls\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.237780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.237780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28888643-211e-4cbf-aa44-6dcbb5d47646-config-volume\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.237780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28888643-211e-4cbf-aa44-6dcbb5d47646-tmp-dir\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.237914 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.237818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v94tt\" (UniqueName: \"kubernetes.io/projected/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-kube-api-access-v94tt\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.300756 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.300718    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sb8tp"
Jul 30 22:41:15.307515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.307493    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl2st"
Jul 30 22:41:15.338688 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28888643-211e-4cbf-aa44-6dcbb5d47646-metrics-tls\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.338847 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.338847 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28888643-211e-4cbf-aa44-6dcbb5d47646-config-volume\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.338847 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28888643-211e-4cbf-aa44-6dcbb5d47646-tmp-dir\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.338847 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v94tt\" (UniqueName: \"kubernetes.io/projected/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-kube-api-access-v94tt\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.339066 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-tmp\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.339066 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.338903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgnld\" (UniqueName: \"kubernetes.io/projected/28888643-211e-4cbf-aa44-6dcbb5d47646-kube-api-access-hgnld\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.339423 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.339394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28888643-211e-4cbf-aa44-6dcbb5d47646-config-volume\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.339539 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.339516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-tmp\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.339621 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.339604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28888643-211e-4cbf-aa44-6dcbb5d47646-tmp-dir\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.341469 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.341450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28888643-211e-4cbf-aa44-6dcbb5d47646-metrics-tls\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.342063 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.342043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.350280 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.350258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v94tt\" (UniqueName: \"kubernetes.io/projected/5a6e381b-1ac8-46f0-aa9a-fc8525f67beb-kube-api-access-v94tt\") pod \"klusterlet-addon-workmgr-5848d7b456-vwr8h\" (UID: \"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.350848 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.350827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgnld\" (UniqueName: \"kubernetes.io/projected/28888643-211e-4cbf-aa44-6dcbb5d47646-kube-api-access-hgnld\") pod \"dns-default-77f27\" (UID: \"28888643-211e-4cbf-aa44-6dcbb5d47646\") " pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.438526 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.438492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:15.452178 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.452153    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl2st"]
Jul 30 22:41:15.455567 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:15.455541    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec5a8da_0990_4c50_afc0_f37c77b49d3e.slice/crio-da44914e45c781af284cbfe405df7a144a3025b8f79322da8ef94d74bcb17958 WatchSource:0}: Error finding container da44914e45c781af284cbfe405df7a144a3025b8f79322da8ef94d74bcb17958: Status 404 returned error can't find the container with id da44914e45c781af284cbfe405df7a144a3025b8f79322da8ef94d74bcb17958
Jul 30 22:41:15.470962 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.470933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sb8tp"]
Jul 30 22:41:15.474255 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:15.474232    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0662dea7_b993_483c_873d_0c6ffc667327.slice/crio-af031b6ea0000bf6b483042fa4f20df4af45b8a6742319fb68b8bba9fa343fbd WatchSource:0}: Error finding container af031b6ea0000bf6b483042fa4f20df4af45b8a6742319fb68b8bba9fa343fbd: Status 404 returned error can't find the container with id af031b6ea0000bf6b483042fa4f20df4af45b8a6742319fb68b8bba9fa343fbd
Jul 30 22:41:15.492643 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.492191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:15.583087 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.583059    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"]
Jul 30 22:41:15.586835 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:15.586809    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6e381b_1ac8_46f0_aa9a_fc8525f67beb.slice/crio-95fa770def66af528220f68f33f9ca754c147fa320d78e158256ef4bbc9f3b45 WatchSource:0}: Error finding container 95fa770def66af528220f68f33f9ca754c147fa320d78e158256ef4bbc9f3b45: Status 404 returned error can't find the container with id 95fa770def66af528220f68f33f9ca754c147fa320d78e158256ef4bbc9f3b45
Jul 30 22:41:15.603137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.602528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h" event={"ID":"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb","Type":"ContainerStarted","Data":"95fa770def66af528220f68f33f9ca754c147fa320d78e158256ef4bbc9f3b45"}
Jul 30 22:41:15.609133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.605166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl2st" event={"ID":"1ec5a8da-0990-4c50-afc0-f37c77b49d3e","Type":"ContainerStarted","Data":"ccc4453f96bfbc8600c5b6a04932dc7d391cdacec21a922bcef44c5fa17c23a1"}
Jul 30 22:41:15.609133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.605232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl2st" event={"ID":"1ec5a8da-0990-4c50-afc0-f37c77b49d3e","Type":"ContainerStarted","Data":"da44914e45c781af284cbfe405df7a144a3025b8f79322da8ef94d74bcb17958"}
Jul 30 22:41:15.609133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.606525    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.609133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.606786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sb8tp" event={"ID":"0662dea7-b993-483c-873d-0c6ffc667327","Type":"ContainerStarted","Data":"af031b6ea0000bf6b483042fa4f20df4af45b8a6742319fb68b8bba9fa343fbd"}
Jul 30 22:41:15.620393 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.620256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:15.641232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641261    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641319    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgqtc\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641387    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration\") pod \"f180f023-8508-40fe-90ee-3acaf8eda0e2\" (UID: \"f180f023-8508-40fe-90ee-3acaf8eda0e2\") "
Jul 30 22:41:15.641761 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641496    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:41:15.641761 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641604    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180f023-8508-40fe-90ee-3acaf8eda0e2-ca-trust-extracted\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.641761 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641623    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:41:15.641761 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.641739    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:41:15.643742 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.643714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:41:15.644034 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.644016    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc" (OuterVolumeSpecName: "kube-api-access-hgqtc") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "kube-api-access-hgqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:41:15.644131 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.644027    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:41:15.644131 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.644120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:41:15.644210 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.644091    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f180f023-8508-40fe-90ee-3acaf8eda0e2" (UID: "f180f023-8508-40fe-90ee-3acaf8eda0e2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:41:15.656092 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.656062    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-77f27"]
Jul 30 22:41:15.659625 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:15.659596    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28888643_211e_4cbf_aa44_6dcbb5d47646.slice/crio-aa8136dae2b5eecd0b7a4c8b930491fd38f7ad8775d71acc80462c071acc214d WatchSource:0}: Error finding container aa8136dae2b5eecd0b7a4c8b930491fd38f7ad8775d71acc80462c071acc214d: Status 404 returned error can't find the container with id aa8136dae2b5eecd0b7a4c8b930491fd38f7ad8775d71acc80462c071acc214d
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742426    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-bound-sa-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742451    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-installation-pull-secrets\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742462    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-certificates\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742471    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgqtc\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-kube-api-access-hgqtc\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742482    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180f023-8508-40fe-90ee-3acaf8eda0e2-image-registry-private-configuration\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742490    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180f023-8508-40fe-90ee-3acaf8eda0e2-registry-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:15.742515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:15.742500    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180f023-8508-40fe-90ee-3acaf8eda0e2-trusted-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:41:16.530552 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.529499    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"]
Jul 30 22:41:16.531702 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.531676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:16.534424 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.534245    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kbmgl\""
Jul 30 22:41:16.534882 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.534715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 22:41:16.539836 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.539767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"]
Jul 30 22:41:16.613893 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.613861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77f27" event={"ID":"28888643-211e-4cbf-aa44-6dcbb5d47646","Type":"ContainerStarted","Data":"aa8136dae2b5eecd0b7a4c8b930491fd38f7ad8775d71acc80462c071acc214d"}
Jul 30 22:41:16.617522 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.617422    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8c6b6f849-g8r6c"
Jul 30 22:41:16.617671 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.617534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl2st" event={"ID":"1ec5a8da-0990-4c50-afc0-f37c77b49d3e","Type":"ContainerStarted","Data":"981c39e2f50faf20530f34f6f6f9f87bbd7d4c718af9cdd44e939cd7583ad385"}
Jul 30 22:41:16.650708 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.650674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-brm9m\" (UID: \"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:16.655515 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.655462    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8c6b6f849-g8r6c"]
Jul 30 22:41:16.661411 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.661379    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8c6b6f849-g8r6c"]
Jul 30 22:41:16.751845 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:16.751239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-brm9m\" (UID: \"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:16.751845 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:16.751446    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 22:41:16.751845 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:16.751511    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates podName:8c0d622a-669f-4880-9ea8-fd19fbaf9ebc nodeName:}" failed. No retries permitted until 2026-07-30 22:41:17.251490978 +0000 UTC m=+58.516736915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-brm9m" (UID: "8c0d622a-669f-4880-9ea8-fd19fbaf9ebc") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 30 22:41:17.240463 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:17.240235    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f180f023-8508-40fe-90ee-3acaf8eda0e2" path="/var/lib/kubelet/pods/f180f023-8508-40fe-90ee-3acaf8eda0e2/volumes"
Jul 30 22:41:17.257246 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:17.257172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-brm9m\" (UID: \"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:17.271262 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:17.271230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c0d622a-669f-4880-9ea8-fd19fbaf9ebc-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-brm9m\" (UID: \"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:17.445858 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:17.445826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:21.414004 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.413969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"]
Jul 30 22:41:21.422124 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:21.422012    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0d622a_669f_4880_9ea8_fd19fbaf9ebc.slice/crio-5f46c3fef18de7938cdeab68a26105cecb07d897b1bd3bea19040a299a9a034c WatchSource:0}: Error finding container 5f46c3fef18de7938cdeab68a26105cecb07d897b1bd3bea19040a299a9a034c: Status 404 returned error can't find the container with id 5f46c3fef18de7938cdeab68a26105cecb07d897b1bd3bea19040a299a9a034c
Jul 30 22:41:21.546857 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.546788    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7v5c"
Jul 30 22:41:21.637049 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.637002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl2st" event={"ID":"1ec5a8da-0990-4c50-afc0-f37c77b49d3e","Type":"ContainerStarted","Data":"467a8bb7a6db287c8b55472b470e84eb355dc11e3882a6d6ca5ebd0ab605c806"}
Jul 30 22:41:21.638283 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.638260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h" event={"ID":"5a6e381b-1ac8-46f0-aa9a-fc8525f67beb","Type":"ContainerStarted","Data":"6f3842813a94f5b2c11e7613d34438bb59118d55d8964ad0e272b5999aa4d93c"}
Jul 30 22:41:21.638412 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.638356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:21.639856 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.639811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sb8tp" event={"ID":"0662dea7-b993-483c-873d-0c6ffc667327","Type":"ContainerStarted","Data":"3a5d6c72653e6c11a1af36180dab2d2b84f4afbdd035842760673df74b1a63ab"}
Jul 30 22:41:21.640219 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.640194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h"
Jul 30 22:41:21.640989 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.640970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m" event={"ID":"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc","Type":"ContainerStarted","Data":"5f46c3fef18de7938cdeab68a26105cecb07d897b1bd3bea19040a299a9a034c"}
Jul 30 22:41:21.642680 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.642658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77f27" event={"ID":"28888643-211e-4cbf-aa44-6dcbb5d47646","Type":"ContainerStarted","Data":"fc75ca08569be504e308a6c8174e05268b48b89bf0cc1dc6ef99aa8ebaa473ce"}
Jul 30 22:41:21.642763 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.642700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-77f27" event={"ID":"28888643-211e-4cbf-aa44-6dcbb5d47646","Type":"ContainerStarted","Data":"7978d9fe14e7900e090746d79ab56372ef118b06a245b66e6ad90baffa894434"}
Jul 30 22:41:21.642763 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.642736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:21.658278 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.658229    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hl2st" podStartSLOduration=1.964484502 podStartE2EDuration="7.658215763s" totalImagesPullingTime="5.693731261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:41:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:21.657847789 +0000 UTC m=+62.923093724" watchObservedRunningTime="2026-07-30 22:41:21.658215763 +0000 UTC m=+62.923461679"
Jul 30 22:41:21.675282 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.675231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-77f27" podStartSLOduration=1.077302247 podStartE2EDuration="6.675216438s" totalImagesPullingTime="5.597914191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:21.674513972 +0000 UTC m=+62.939759909" watchObservedRunningTime="2026-07-30 22:41:21.675216438 +0000 UTC m=+62.940462374"
Jul 30 22:41:21.691933 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.691889    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sb8tp" podStartSLOduration=1.88782844 podStartE2EDuration="7.691875776s" totalImagesPullingTime="5.804047336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:21.691784217 +0000 UTC m=+62.957030154" watchObservedRunningTime="2026-07-30 22:41:21.691875776 +0000 UTC m=+62.957121713"
Jul 30 22:41:21.710750 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:21.710693    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5848d7b456-vwr8h" podStartSLOduration=0.995510639 podStartE2EDuration="6.710670831s" totalImagesPullingTime="5.715160192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:21.710332961 +0000 UTC m=+62.975578898" watchObservedRunningTime="2026-07-30 22:41:21.710670831 +0000 UTC m=+62.975916769"
Jul 30 22:41:22.649010 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:22.648960    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m" event={"ID":"8c0d622a-669f-4880-9ea8-fd19fbaf9ebc","Type":"ContainerStarted","Data":"e871f16d8ccf8ccc5fce2e15c982f6e692d9f2ef2944eeadb213b521708e8f08"}
Jul 30 22:41:22.669067 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:22.669013    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m" podStartSLOduration=5.624663345 podStartE2EDuration="6.668994906s" totalImagesPullingTime="1.044331561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:22.668525611 +0000 UTC m=+63.933771549" watchObservedRunningTime="2026-07-30 22:41:22.668994906 +0000 UTC m=+63.934240843"
Jul 30 22:41:23.652031 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:23.652003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:23.656544 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:23.656524    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-brm9m"
Jul 30 22:41:24.620293 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.620260    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-nh2td"]
Jul 30 22:41:24.623220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.623206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.627222 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627199    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 22:41:24.627375 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627354    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 22:41:24.627451 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627359    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 22:41:24.627451 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 22:41:24.627553 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627399    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 22:41:24.627610 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.627562    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xpvc7\""
Jul 30 22:41:24.633039 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.633017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-nh2td"]
Jul 30 22:41:24.720714 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.720680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.720714 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.720713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.721140 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.720746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jxms\" (UniqueName: \"kubernetes.io/projected/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-kube-api-access-4jxms\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.721140 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.720831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.822888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.822120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.822888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.822187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.822888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.822259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jxms\" (UniqueName: \"kubernetes.io/projected/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-kube-api-access-4jxms\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.822888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.822327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.825113 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.824400    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.826033 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.825498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.826033 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.825828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.834338 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.834316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jxms\" (UniqueName: \"kubernetes.io/projected/20b51c8d-d7a7-4d27-8128-6ecad0b930ba-kube-api-access-4jxms\") pod \"prometheus-operator-758d7cb874-nh2td\" (UID: \"20b51c8d-d7a7-4d27-8128-6ecad0b930ba\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:24.932066 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:24.931992    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td"
Jul 30 22:41:25.023595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.023558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:41:25.023721 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.023644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:41:25.027802 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.027778    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:41:25.027934 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.027896    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:41:25.036648 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.036625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de59c87b-7872-423b-bdf2-d6f519e5018a-metrics-certs\") pod \"network-metrics-daemon-7dfp9\" (UID: \"de59c87b-7872-423b-bdf2-d6f519e5018a\") " pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:41:25.036928 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.036908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b764ae7b-67f3-4752-abe4-d930ecc39ffe-original-pull-secret\") pod \"global-pull-secret-syncer-mbpsh\" (UID: \"b764ae7b-67f3-4752-abe4-d930ecc39ffe\") " pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:41:25.059928 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.059908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-nh2td"]
Jul 30 22:41:25.062461 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:25.062438    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b51c8d_d7a7_4d27_8128_6ecad0b930ba.slice/crio-11cb5792ad6d986a0cca8d6c8cdcb8914521ebbd242d9963ab5db4a0f9cd7084 WatchSource:0}: Error finding container 11cb5792ad6d986a0cca8d6c8cdcb8914521ebbd242d9963ab5db4a0f9cd7084: Status 404 returned error can't find the container with id 11cb5792ad6d986a0cca8d6c8cdcb8914521ebbd242d9963ab5db4a0f9cd7084
Jul 30 22:41:25.124115 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.124073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:41:25.127124 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.127087    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 22:41:25.137231 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.137218    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 22:41:25.147681 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.147662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbwq\" (UniqueName: \"kubernetes.io/projected/6b97aaf5-0ba3-47e5-a5df-a28e91daa412-kube-api-access-9cbwq\") pod \"network-check-target-cjcmz\" (UID: \"6b97aaf5-0ba3-47e5-a5df-a28e91daa412\") " pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:41:25.246423 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.246403    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbpsh"
Jul 30 22:41:25.255075 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.255057    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-29hrf\""
Jul 30 22:41:25.260749 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.260734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qzp2k\""
Jul 30 22:41:25.262793 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.262779    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dfp9"
Jul 30 22:41:25.268698 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.268665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:41:25.392827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.392795    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbpsh"]
Jul 30 22:41:25.398696 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:25.398670    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb764ae7b_67f3_4752_abe4_d930ecc39ffe.slice/crio-f0bf95829fbc2ff3e1cb73da4fe20599872dd27c0d908c2ae41fe94660bad7f7 WatchSource:0}: Error finding container f0bf95829fbc2ff3e1cb73da4fe20599872dd27c0d908c2ae41fe94660bad7f7: Status 404 returned error can't find the container with id f0bf95829fbc2ff3e1cb73da4fe20599872dd27c0d908c2ae41fe94660bad7f7
Jul 30 22:41:25.419355 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.419323    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dfp9"]
Jul 30 22:41:25.422190 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:25.422168    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde59c87b_7872_423b_bdf2_d6f519e5018a.slice/crio-cc2d140b2e8ae967e605c27828a0174a093c0b833b4edddf10ce8b0b348d3ba9 WatchSource:0}: Error finding container cc2d140b2e8ae967e605c27828a0174a093c0b833b4edddf10ce8b0b348d3ba9: Status 404 returned error can't find the container with id cc2d140b2e8ae967e605c27828a0174a093c0b833b4edddf10ce8b0b348d3ba9
Jul 30 22:41:25.431993 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.431975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjcmz"]
Jul 30 22:41:25.434246 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:25.434227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b97aaf5_0ba3_47e5_a5df_a28e91daa412.slice/crio-e77b2a99583caf4d6a39c02552aceee9215fe19965e423b3ec4619bbeaa36cc8 WatchSource:0}: Error finding container e77b2a99583caf4d6a39c02552aceee9215fe19965e423b3ec4619bbeaa36cc8: Status 404 returned error can't find the container with id e77b2a99583caf4d6a39c02552aceee9215fe19965e423b3ec4619bbeaa36cc8
Jul 30 22:41:25.662512 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.662424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjcmz" event={"ID":"6b97aaf5-0ba3-47e5-a5df-a28e91daa412","Type":"ContainerStarted","Data":"e77b2a99583caf4d6a39c02552aceee9215fe19965e423b3ec4619bbeaa36cc8"}
Jul 30 22:41:25.663493 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.663473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dfp9" event={"ID":"de59c87b-7872-423b-bdf2-d6f519e5018a","Type":"ContainerStarted","Data":"cc2d140b2e8ae967e605c27828a0174a093c0b833b4edddf10ce8b0b348d3ba9"}
Jul 30 22:41:25.664629 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.664608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td" event={"ID":"20b51c8d-d7a7-4d27-8128-6ecad0b930ba","Type":"ContainerStarted","Data":"11cb5792ad6d986a0cca8d6c8cdcb8914521ebbd242d9963ab5db4a0f9cd7084"}
Jul 30 22:41:25.665556 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:25.665537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbpsh" event={"ID":"b764ae7b-67f3-4752-abe4-d930ecc39ffe","Type":"ContainerStarted","Data":"f0bf95829fbc2ff3e1cb73da4fe20599872dd27c0d908c2ae41fe94660bad7f7"}
Jul 30 22:41:26.240035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.239953    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-cn542"]
Jul 30 22:41:26.243070 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.243047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:26.246728 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.246459    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dskh6\""
Jul 30 22:41:26.246728 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.246535    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 22:41:26.246728 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.246616    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 22:41:26.264044 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.264018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-cn542"]
Jul 30 22:41:26.332757 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.332720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdkq\" (UniqueName: \"kubernetes.io/projected/0a2b87ee-1eb4-4e75-b74d-49095813c309-kube-api-access-jfdkq\") pod \"downloads-77c974ffcf-cn542\" (UID: \"0a2b87ee-1eb4-4e75-b74d-49095813c309\") " pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:26.433328 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.433294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdkq\" (UniqueName: \"kubernetes.io/projected/0a2b87ee-1eb4-4e75-b74d-49095813c309-kube-api-access-jfdkq\") pod \"downloads-77c974ffcf-cn542\" (UID: \"0a2b87ee-1eb4-4e75-b74d-49095813c309\") " pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:26.446376 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.446348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdkq\" (UniqueName: \"kubernetes.io/projected/0a2b87ee-1eb4-4e75-b74d-49095813c309-kube-api-access-jfdkq\") pod \"downloads-77c974ffcf-cn542\" (UID: \"0a2b87ee-1eb4-4e75-b74d-49095813c309\") " pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:26.555283 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:26.555196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:27.536703 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.536678    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-cn542"]
Jul 30 22:41:27.540762 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:27.540731    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2b87ee_1eb4_4e75_b74d_49095813c309.slice/crio-2f41f7bd0852b7affc380b6cea330a3e9efcdfca31f9af10710f3ea2af8058d0 WatchSource:0}: Error finding container 2f41f7bd0852b7affc380b6cea330a3e9efcdfca31f9af10710f3ea2af8058d0: Status 404 returned error can't find the container with id 2f41f7bd0852b7affc380b6cea330a3e9efcdfca31f9af10710f3ea2af8058d0
Jul 30 22:41:27.678973 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.678941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dfp9" event={"ID":"de59c87b-7872-423b-bdf2-d6f519e5018a","Type":"ContainerStarted","Data":"001ff92e523b22958d88810977dd59baa8370648c3e8d7f11f3f22378290faac"}
Jul 30 22:41:27.681827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.681736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td" event={"ID":"20b51c8d-d7a7-4d27-8128-6ecad0b930ba","Type":"ContainerStarted","Data":"25350a8142b344f743cb15d44d44bc352a2305b7523109938ab5af5aa7f91b82"}
Jul 30 22:41:27.681827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.681792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td" event={"ID":"20b51c8d-d7a7-4d27-8128-6ecad0b930ba","Type":"ContainerStarted","Data":"8bcc420b480b6e23e241e3156290cf343e39ab19125f66dc8f726225b0f4707e"}
Jul 30 22:41:27.684309 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.684280    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-cn542" event={"ID":"0a2b87ee-1eb4-4e75-b74d-49095813c309","Type":"ContainerStarted","Data":"2f41f7bd0852b7affc380b6cea330a3e9efcdfca31f9af10710f3ea2af8058d0"}
Jul 30 22:41:27.732593 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:27.732242    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-nh2td" podStartSLOduration=1.426256786 podStartE2EDuration="3.732220275s" totalImagesPullingTime="2.305963489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:27.730337495 +0000 UTC m=+68.995583512" watchObservedRunningTime="2026-07-30 22:41:27.732220275 +0000 UTC m=+68.997466214"
Jul 30 22:41:28.690765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:28.690655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dfp9" event={"ID":"de59c87b-7872-423b-bdf2-d6f519e5018a","Type":"ContainerStarted","Data":"cfda36fd7b154570d2e09989c5c19f8299b89c7153f84ec406802498a7064479"}
Jul 30 22:41:28.708991 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:28.708892    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7dfp9" podStartSLOduration=67.76515624 podStartE2EDuration="1m9.708873389s" totalImagesPullingTime="1.943717149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:28.707808179 +0000 UTC m=+69.973054116" watchObservedRunningTime="2026-07-30 22:41:28.708873389 +0000 UTC m=+69.974119328"
Jul 30 22:41:31.652475 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:31.652081    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-77f27"
Jul 30 22:41:31.708737 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:31.708693    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbpsh" event={"ID":"b764ae7b-67f3-4752-abe4-d930ecc39ffe","Type":"ContainerStarted","Data":"70ab1c0c969490cdb2a3621473980c8b9529c13dcbdfd9b663ff980032738128"}
Jul 30 22:41:31.712384 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:31.712348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjcmz" event={"ID":"6b97aaf5-0ba3-47e5-a5df-a28e91daa412","Type":"ContainerStarted","Data":"8e96a2daed47b52a8c664de3d67ffaa4a157d0fd17cec0325764772649eeeccc"}
Jul 30 22:41:31.712828 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:31.712808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:41:31.733692 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:31.731520    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mbpsh" podStartSLOduration=67.363156535 podStartE2EDuration="1m12.731501996s" totalImagesPullingTime="5.368345461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:31.729150584 +0000 UTC m=+72.994396525" watchObservedRunningTime="2026-07-30 22:41:31.731501996 +0000 UTC m=+72.996747933"
Jul 30 22:41:33.748263 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.748206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cjcmz" podStartSLOduration=69.422019201 podStartE2EDuration="1m14.748184356s" totalImagesPullingTime="5.326165155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:31.746612516 +0000 UTC m=+73.011858451" watchObservedRunningTime="2026-07-30 22:41:33.748184356 +0000 UTC m=+75.013430295"
Jul 30 22:41:33.749146 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.749126    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"]
Jul 30 22:41:33.751405 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.751386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.754155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.754132    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 22:41:33.754155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.754152    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 22:41:33.754327 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.754217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wdg4g\""
Jul 30 22:41:33.762610 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.762586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"]
Jul 30 22:41:33.766144 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.766118    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"]
Jul 30 22:41:33.768562 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.768540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.771335 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.771310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 22:41:33.771478 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.771444    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 22:41:33.771577 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.771538    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 22:41:33.771681 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.771637    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hq4sp\""
Jul 30 22:41:33.790591 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.790568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"]
Jul 30 22:41:33.834808 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.834775    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lqm85"]
Jul 30 22:41:33.837495 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.837466    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.845517 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.844808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-94cf2\""
Jul 30 22:41:33.845517 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.844808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 22:41:33.845517 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.844808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 22:41:33.845517 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.845050    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 22:41:33.897495 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-wtmp\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qm69\" (UniqueName: \"kubernetes.io/projected/6082251b-5e85-4b69-8225-fd88e4e03680-kube-api-access-9qm69\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.897609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897727 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897727 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.897727 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897727 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-sys\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-root\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-tls\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6082251b-5e85-4b69-8225-fd88e4e03680-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.897839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-textfile\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckg26\" (UniqueName: \"kubernetes.io/projected/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-api-access-ckg26\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-metrics-client-ca\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkxwq\" (UniqueName: \"kubernetes.io/projected/77938e2d-1547-4b8e-acee-f855256c97d1-kube-api-access-pkxwq\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.897975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.897942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.999228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.999228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.999228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-sys\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-root\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-tls\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6082251b-5e85-4b69-8225-fd88e4e03680-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-sys\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-textfile\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckg26\" (UniqueName: \"kubernetes.io/projected/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-api-access-ckg26\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-metrics-client-ca\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkxwq\" (UniqueName: \"kubernetes.io/projected/77938e2d-1547-4b8e-acee-f855256c97d1-kube-api-access-pkxwq\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-wtmp\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qm69\" (UniqueName: \"kubernetes.io/projected/6082251b-5e85-4b69-8225-fd88e4e03680-kube-api-access-9qm69\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-textfile\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:33.999600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999645    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:33.999798    2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:33.999870    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls podName:6082251b-5e85-4b69-8225-fd88e4e03680 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:34.499849974 +0000 UTC m=+75.765095894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-bh6lr" (UID: "6082251b-5e85-4b69-8225-fd88e4e03680") : secret "openshift-state-metrics-tls" not found
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-root\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:33.999989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6082251b-5e85-4b69-8225-fd88e4e03680-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:34.000253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.000092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.000714 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.000356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-wtmp\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.000769 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.000719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77938e2d-1547-4b8e-acee-f855256c97d1-metrics-client-ca\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.000769 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.000730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.002773 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.002749    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.002975 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.002954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:34.003077 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.003064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.003220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.003194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-tls\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.003606 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.003589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77938e2d-1547-4b8e-acee-f855256c97d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.020061 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.020020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckg26\" (UniqueName: \"kubernetes.io/projected/9c0b51a8-b609-4e6f-ac74-9a4b5734fe34-kube-api-access-ckg26\") pod \"kube-state-metrics-6bd9664c4-8jftw\" (UID: \"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.020399 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.020376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkxwq\" (UniqueName: \"kubernetes.io/projected/77938e2d-1547-4b8e-acee-f855256c97d1-kube-api-access-pkxwq\") pod \"node-exporter-lqm85\" (UID: \"77938e2d-1547-4b8e-acee-f855256c97d1\") " pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.021801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.021776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qm69\" (UniqueName: \"kubernetes.io/projected/6082251b-5e85-4b69-8225-fd88e4e03680-kube-api-access-9qm69\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:34.079216 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.079183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"
Jul 30 22:41:34.148454 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.148411    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqm85"
Jul 30 22:41:34.161584 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:34.161547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77938e2d_1547_4b8e_acee_f855256c97d1.slice/crio-a51ebd25dfd52111a322302a7a820ff1dcfe6a17ad82208e3b082a5662630773 WatchSource:0}: Error finding container a51ebd25dfd52111a322302a7a820ff1dcfe6a17ad82208e3b082a5662630773: Status 404 returned error can't find the container with id a51ebd25dfd52111a322302a7a820ff1dcfe6a17ad82208e3b082a5662630773
Jul 30 22:41:34.229824 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.229794    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw"]
Jul 30 22:41:34.232783 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:34.232757    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0b51a8_b609_4e6f_ac74_9a4b5734fe34.slice/crio-3341bdd0d0ccd04b61d2490377d20511da9e0c64844814babeef70b6531ac63a WatchSource:0}: Error finding container 3341bdd0d0ccd04b61d2490377d20511da9e0c64844814babeef70b6531ac63a: Status 404 returned error can't find the container with id 3341bdd0d0ccd04b61d2490377d20511da9e0c64844814babeef70b6531ac63a
Jul 30 22:41:34.503755 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.503692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:34.503941 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:34.503828    2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 30 22:41:34.503941 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:41:34.503905    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls podName:6082251b-5e85-4b69-8225-fd88e4e03680 nodeName:}" failed. No retries permitted until 2026-07-30 22:41:35.503887465 +0000 UTC m=+76.769133381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-bh6lr" (UID: "6082251b-5e85-4b69-8225-fd88e4e03680") : secret "openshift-state-metrics-tls" not found
Jul 30 22:41:34.725506 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.725464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw" event={"ID":"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34","Type":"ContainerStarted","Data":"3341bdd0d0ccd04b61d2490377d20511da9e0c64844814babeef70b6531ac63a"}
Jul 30 22:41:34.726999 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.726973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqm85" event={"ID":"77938e2d-1547-4b8e-acee-f855256c97d1","Type":"ContainerStarted","Data":"a51ebd25dfd52111a322302a7a820ff1dcfe6a17ad82208e3b082a5662630773"}
Jul 30 22:41:34.762487 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.762410    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:41:34.766106 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.766069    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.769015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.768715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rbb4\""
Jul 30 22:41:34.769015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.768761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 22:41:34.769015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.768771    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 22:41:34.769015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.768722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 22:41:34.769015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.768955    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 22:41:34.769375 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.769254    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 22:41:34.769375 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.769262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 22:41:34.769375 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.769285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 22:41:34.769590 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.769571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 22:41:34.769733 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.769716    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 22:41:34.786495 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.786450    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:41:34.908483 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908483 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf28c\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.908873 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.909034 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:34.909034 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:34.908933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010436 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010600 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf28c\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.010887 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.010779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.011568 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.011541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.013117 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.013029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.013351 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.013332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.017533 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.017493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.018366 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.018328    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.020290 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.020263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.022461 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.022419    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.022658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.022606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.022767 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.022682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.023673 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.022955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.024132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.023867    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf28c\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.024774 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.024752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.024900 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.024875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.080252 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.079994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:41:35.248149 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.248111    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:41:35.410329 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:35.410260    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1416d022_4f0b_48b0_b3f1_a9424b3e2e4b.slice/crio-a31fd06e30befaeda5f61083ad230d57675cc3d40b5f029b1925a11666f05548 WatchSource:0}: Error finding container a31fd06e30befaeda5f61083ad230d57675cc3d40b5f029b1925a11666f05548: Status 404 returned error can't find the container with id a31fd06e30befaeda5f61083ad230d57675cc3d40b5f029b1925a11666f05548
Jul 30 22:41:35.515615 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.515580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:35.518575 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.518549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6082251b-5e85-4b69-8225-fd88e4e03680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bh6lr\" (UID: \"6082251b-5e85-4b69-8225-fd88e4e03680\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:35.564229 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.564196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"
Jul 30 22:41:35.735066 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.735030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"a31fd06e30befaeda5f61083ad230d57675cc3d40b5f029b1925a11666f05548"}
Jul 30 22:41:35.811356 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.811321    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"]
Jul 30 22:41:35.813994 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.813975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.817889 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.817858    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 22:41:35.819137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.818169    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-djk2c7ll0f763\""
Jul 30 22:41:35.819137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.818410    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 22:41:35.819137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.818601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f6k9m\""
Jul 30 22:41:35.819137 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.818901    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 22:41:35.819426 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.819406    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 22:41:35.819644 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.819630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 22:41:35.830968 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.830943    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"]
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-metrics-client-ca\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-grpc-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfbvn\" (UniqueName: \"kubernetes.io/projected/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-kube-api-access-rfbvn\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:35.919276 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:35.918893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.005190 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.005074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr"]
Jul 30 22:41:36.013563 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.013533    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:41:36.015842 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.015819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.019850 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.019772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-metrics-client-ca\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.019850 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.019810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-grpc-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.019995 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.019975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020055 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020131 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020131 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfbvn\" (UniqueName: \"kubernetes.io/projected/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-kube-api-access-rfbvn\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.020480 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.020448    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-metrics-client-ca\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.022963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.021868    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 22:41:36.022963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.022365    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 22:41:36.022963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.022630    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 22:41:36.022963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.022798    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 22:41:36.023202 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.023175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.023723 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.023325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.023723 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.023462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.023723 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.023522    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 22:41:36.023723 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.023691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-grpc-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.024362 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.024344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-tls\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.024732 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.024713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.026588 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.026572    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4dxjf\""
Jul 30 22:41:36.043499 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:36.043459    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6082251b_5e85_4b69_8225_fd88e4e03680.slice/crio-217850f1539913dbd740b09c768c00dd7966a4c995c0668f82d8d571b1939f0e WatchSource:0}: Error finding container 217850f1539913dbd740b09c768c00dd7966a4c995c0668f82d8d571b1939f0e: Status 404 returned error can't find the container with id 217850f1539913dbd740b09c768c00dd7966a4c995c0668f82d8d571b1939f0e
Jul 30 22:41:36.048134 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.048082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:41:36.050628 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.050570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfbvn\" (UniqueName: \"kubernetes.io/projected/4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1-kube-api-access-rfbvn\") pod \"thanos-querier-78c48f87d7-8k8wj\" (UID: \"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1\") " pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.120655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.120826 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sfhv\" (UniqueName: \"kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.120826 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.120826 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.120988 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.120988 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.120864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.133762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.133644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sfhv\" (UniqueName: \"kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.223724 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.222431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.224199 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.224016    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.225444 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.224974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.225444 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.225392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.227726 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.227698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.229853 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.229811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.233396 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.233357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sfhv\" (UniqueName: \"kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv\") pod \"console-5bc87b555c-4tl4g\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") " pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.358974 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.358887    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"]
Jul 30 22:41:36.362001 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:36.361972    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc7f6f8_30a1_4305_ab8f_f54efe3aabd1.slice/crio-16e5a03c0ed16bb5f04d74f6566379c5e2d31bb8ff6979e8e9d99cdc69329206 WatchSource:0}: Error finding container 16e5a03c0ed16bb5f04d74f6566379c5e2d31bb8ff6979e8e9d99cdc69329206: Status 404 returned error can't find the container with id 16e5a03c0ed16bb5f04d74f6566379c5e2d31bb8ff6979e8e9d99cdc69329206
Jul 30 22:41:36.439568 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.439533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:36.606272 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.606242    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:41:36.745721 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.745682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw" event={"ID":"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34","Type":"ContainerStarted","Data":"a25a7de3df27a4eed586c37efa6cf5a3e1759b70ef1f0808bafc3c67a33853b5"}
Jul 30 22:41:36.745883 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.745755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw" event={"ID":"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34","Type":"ContainerStarted","Data":"d1a53e280382044aaec246612ae631e63abcb422dd88c81ac877b9b04769e57c"}
Jul 30 22:41:36.745883 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.745786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw" event={"ID":"9c0b51a8-b609-4e6f-ac74-9a4b5734fe34","Type":"ContainerStarted","Data":"c1183fe1aa9390e7da8fe490938bb16681d9b36f7ac98416700fae91e9dceb9e"}
Jul 30 22:41:36.747964 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.747937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"16e5a03c0ed16bb5f04d74f6566379c5e2d31bb8ff6979e8e9d99cdc69329206"}
Jul 30 22:41:36.749973 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.749948    2559 generic.go:356] "Generic (PLEG): container finished" podID="77938e2d-1547-4b8e-acee-f855256c97d1" containerID="e666cc599a27129e05a9669669e338915b8b342824c36b3900e20e267b38cae7" exitCode=0
Jul 30 22:41:36.750122 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.750044    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqm85" event={"ID":"77938e2d-1547-4b8e-acee-f855256c97d1","Type":"ContainerDied","Data":"e666cc599a27129e05a9669669e338915b8b342824c36b3900e20e267b38cae7"}
Jul 30 22:41:36.752446 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.752391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr" event={"ID":"6082251b-5e85-4b69-8225-fd88e4e03680","Type":"ContainerStarted","Data":"807b7ee84e596a9ce1cd739f74c8541fd5d2ce71e7cdf921517d7514ad0c3bf6"}
Jul 30 22:41:36.752446 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.752436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr" event={"ID":"6082251b-5e85-4b69-8225-fd88e4e03680","Type":"ContainerStarted","Data":"3deecf98d37be1650b0832e6ea9c0321be119fce69fe9ca8c5135792fc4c5930"}
Jul 30 22:41:36.752604 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.752469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr" event={"ID":"6082251b-5e85-4b69-8225-fd88e4e03680","Type":"ContainerStarted","Data":"217850f1539913dbd740b09c768c00dd7966a4c995c0668f82d8d571b1939f0e"}
Jul 30 22:41:36.768553 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:36.768482    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8jftw" podStartSLOduration=2.201287459 podStartE2EDuration="3.768456659s" totalImagesPullingTime="1.5671692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:36.767358573 +0000 UTC m=+78.032604510" watchObservedRunningTime="2026-07-30 22:41:36.768456659 +0000 UTC m=+78.033702595"
Jul 30 22:41:36.862049 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:36.862013    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9986fc29_1046_46e1_97a9_adbc39e5518f.slice/crio-66b5f83b775885b52ff16fcad16d546a9d6c107805a82df7dc7adcf632b6eee1 WatchSource:0}: Error finding container 66b5f83b775885b52ff16fcad16d546a9d6c107805a82df7dc7adcf632b6eee1: Status 404 returned error can't find the container with id 66b5f83b775885b52ff16fcad16d546a9d6c107805a82df7dc7adcf632b6eee1
Jul 30 22:41:37.763035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.763001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqm85" event={"ID":"77938e2d-1547-4b8e-acee-f855256c97d1","Type":"ContainerStarted","Data":"ea9895e56b27808d0191ef76ba27138183841443c634bd79991dfceb2ca666ba"}
Jul 30 22:41:37.763167 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.763131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqm85" event={"ID":"77938e2d-1547-4b8e-acee-f855256c97d1","Type":"ContainerStarted","Data":"2f5dfe54e2f4b1973f3e13437c7bcd225a788daec45ac8979273112b4ebd9f35"}
Jul 30 22:41:37.765979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.765952    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4" exitCode=0
Jul 30 22:41:37.766084 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.766032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"}
Jul 30 22:41:37.768882 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.768859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc87b555c-4tl4g" event={"ID":"9986fc29-1046-46e1-97a9-adbc39e5518f","Type":"ContainerStarted","Data":"66b5f83b775885b52ff16fcad16d546a9d6c107805a82df7dc7adcf632b6eee1"}
Jul 30 22:41:37.797255 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:37.795900    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lqm85" podStartSLOduration=3.063118884 podStartE2EDuration="4.795879429s" totalImagesPullingTime="1.636560488s" totalInitContainerRuntime="96.200057ms" isStatefulPod=true podCreationTimestamp="2026-07-30 22:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:37.795243154 +0000 UTC m=+79.060489091" watchObservedRunningTime="2026-07-30 22:41:37.795879429 +0000 UTC m=+79.061125367"
Jul 30 22:41:38.154145 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.152658    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dcc645679-vndxt"]
Jul 30 22:41:38.156680 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.156286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.159978    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.160074    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-59sgv\""
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.160233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3k3uqjd1c82sa\""
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.160253    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.160314    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 22:41:38.160594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.160395    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 22:41:38.178394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.178336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcc645679-vndxt"]
Jul 30 22:41:38.247878 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.247845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt6z9\" (UniqueName: \"kubernetes.io/projected/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-kube-api-access-qt6z9\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248032 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.247912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-client-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248032 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.247967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-audit-log\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248032 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.247993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-metrics-server-audit-profiles\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248032 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.248025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-client-certs\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248270 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.248056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-tls\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.248270 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.248086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349052 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-audit-log\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-metrics-server-audit-profiles\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-client-certs\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-tls\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349420 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt6z9\" (UniqueName: \"kubernetes.io/projected/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-kube-api-access-qt6z9\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.349420 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.349292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-client-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.351830 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.350918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-audit-log\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.351830 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.351788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.352163 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.352071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-metrics-server-audit-profiles\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.354153 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.354089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-client-ca-bundle\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.357626 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.357596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-tls\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.357825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.357805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-secret-metrics-server-client-certs\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.361177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.361133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt6z9\" (UniqueName: \"kubernetes.io/projected/9a3ab9c9-e3c2-41ae-a3a4-c6356897e963-kube-api-access-qt6z9\") pod \"metrics-server-dcc645679-vndxt\" (UID: \"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963\") " pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.469631 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.469548    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:38.525249 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.525218    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"]
Jul 30 22:41:38.528869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.528843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.531342 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.531314    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 22:41:38.531458 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.531389    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rqdjf\""
Jul 30 22:41:38.536329 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.536276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"]
Jul 30 22:41:38.652710 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.652674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l869\" (UniqueName: \"kubernetes.io/projected/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-kube-api-access-5l869\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.652888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.652730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.754644 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.753756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l869\" (UniqueName: \"kubernetes.io/projected/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-kube-api-access-5l869\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.754644 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.753816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.762882 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.762850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.765203 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.765141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l869\" (UniqueName: \"kubernetes.io/projected/94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b-kube-api-access-5l869\") pod \"monitoring-plugin-6dffbbd67-qvhhz\" (UID: \"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:38.777607 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.777575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr" event={"ID":"6082251b-5e85-4b69-8225-fd88e4e03680","Type":"ContainerStarted","Data":"383516c1420d7726fd43a7042f595ad91d1a5574aaf4cd65ba13de74875ce511"}
Jul 30 22:41:38.798279 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.798216    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bh6lr" podStartSLOduration=4.39105975 podStartE2EDuration="5.798193259s" totalImagesPullingTime="1.407133509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:38.797261565 +0000 UTC m=+80.062507506" watchObservedRunningTime="2026-07-30 22:41:38.798193259 +0000 UTC m=+80.063439198"
Jul 30 22:41:38.849609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:38.849397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:44.929167 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:44.929007    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:41:44.964789 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:44.964750    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:41:44.965006 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:44.964910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:44.973790 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:44.972751    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 22:41:45.120363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120322    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120726 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120726 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgxn\" (UniqueName: \"kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120726 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120726 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120949 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.120949 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.120770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.221855 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.221767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.221855 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.221818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgxn\" (UniqueName: \"kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.221855 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.221842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.221879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.222035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.222086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222311 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.222193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222604 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.222554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.222731 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.222660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.223044 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.223017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.223288 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.223267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.224836 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.224812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.225333 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.225313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.231564 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.231505    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgxn\" (UniqueName: \"kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn\") pod \"console-6c457f4c78-lqwzv\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") " pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:45.277925 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:45.277705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:48.840502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.838245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc87b555c-4tl4g" event={"ID":"9986fc29-1046-46e1-97a9-adbc39e5518f","Type":"ContainerStarted","Data":"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"}
Jul 30 22:41:48.854498 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.850075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-cn542" event={"ID":"0a2b87ee-1eb4-4e75-b74d-49095813c309","Type":"ContainerStarted","Data":"b688e98f448d71b1696c88ff2c1db1c576dce23947775609324db6ac3ca6e42d"}
Jul 30 22:41:48.854498 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.852377    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:48.854498 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.852410    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dcc645679-vndxt"]
Jul 30 22:41:48.854498 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.854241    2559 patch_prober.go:28] interesting pod/downloads-77c974ffcf-cn542 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body=
Jul 30 22:41:48.854498 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.854294    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-77c974ffcf-cn542" podUID="0a2b87ee-1eb4-4e75-b74d-49095813c309" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused"
Jul 30 22:41:48.855395 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.855361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"b9f8e55bfe58765b5a79f55025e71f0983531cb2e298ef89e5600a9c3baba360"}
Jul 30 22:41:48.857213 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:41:48.857167    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3ab9c9_e3c2_41ae_a3a4_c6356897e963.slice/crio-c544583c0c90c7a9210a64e61a340dfbf6f434fe7b1cc07739faadd4c2c7eee2 WatchSource:0}: Error finding container c544583c0c90c7a9210a64e61a340dfbf6f434fe7b1cc07739faadd4c2c7eee2: Status 404 returned error can't find the container with id c544583c0c90c7a9210a64e61a340dfbf6f434fe7b1cc07739faadd4c2c7eee2
Jul 30 22:41:48.863654 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.863592    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc87b555c-4tl4g" podStartSLOduration=2.097723625 podStartE2EDuration="13.863569436s" totalImagesPullingTime="11.765845811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:48.860729999 +0000 UTC m=+90.125975951" watchObservedRunningTime="2026-07-30 22:41:48.863569436 +0000 UTC m=+90.128815373"
Jul 30 22:41:48.869356 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.869166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:41:48.873068 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.873029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"]
Jul 30 22:41:48.883364 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:48.882618    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-cn542" podStartSLOduration=1.795686514 podStartE2EDuration="22.882596479s" totalImagesPullingTime="21.086909965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:48.880831735 +0000 UTC m=+90.146077666" watchObservedRunningTime="2026-07-30 22:41:48.882596479 +0000 UTC m=+90.147842417"
Jul 30 22:41:49.885214 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.885162    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz" event={"ID":"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b","Type":"ContainerStarted","Data":"d081fd837e7e21daf031a8242db8a2e29f78386a28741887358f754a7cb785fd"}
Jul 30 22:41:49.895349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.895242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcc645679-vndxt" event={"ID":"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963","Type":"ContainerStarted","Data":"c544583c0c90c7a9210a64e61a340dfbf6f434fe7b1cc07739faadd4c2c7eee2"}
Jul 30 22:41:49.899550 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.899381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"b2f1d65e44e69b099dd7481e2532586c23fd0645019314f7004e1b6833130db6"}
Jul 30 22:41:49.899550 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.899472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"b353fc3891a4e7e7313c333fbdac57e8d732ea3fd37883bd1e8638084bbdc469"}
Jul 30 22:41:49.906528 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.906495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"}
Jul 30 22:41:49.906795 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.906767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"}
Jul 30 22:41:49.906994 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.906966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"}
Jul 30 22:41:49.907202 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.907175    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"}
Jul 30 22:41:49.907525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.907491    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"}
Jul 30 22:41:49.916201 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.916164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c457f4c78-lqwzv" event={"ID":"f5c27f05-d17a-4a68-941c-bc7dbb03f873","Type":"ContainerStarted","Data":"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"}
Jul 30 22:41:49.918395 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.918362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c457f4c78-lqwzv" event={"ID":"f5c27f05-d17a-4a68-941c-bc7dbb03f873","Type":"ContainerStarted","Data":"619acf50b3eab81f9f7f7d8b638ecd9674c967eb3bf14954714338a790fc1895"}
Jul 30 22:41:49.938777 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.938734    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-cn542"
Jul 30 22:41:49.961131 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:49.960495    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c457f4c78-lqwzv" podStartSLOduration=5.960469896 podStartE2EDuration="5.960469896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:49.938913488 +0000 UTC m=+91.204159426" watchObservedRunningTime="2026-07-30 22:41:49.960469896 +0000 UTC m=+91.225715836"
Jul 30 22:41:52.938160 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.938121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"3555b326600c816713090e18a2e045c5ca77824a05ee6919aaf8902aaaf1986f"}
Jul 30 22:41:52.938806 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.938786    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:52.938970 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.938949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"9c53c33c0a3319534027b7e3eb78fb952eda8f6b293f610400cdbac0eecd82db"}
Jul 30 22:41:52.939052 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.938999    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" event={"ID":"4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1","Type":"ContainerStarted","Data":"93fea11e80c8b3a90b62eba6c433deb3fbf4f6fa540c4d83175fd59d43381c39"}
Jul 30 22:41:52.942608 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.942569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerStarted","Data":"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"}
Jul 30 22:41:52.944765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.944730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz" event={"ID":"94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b","Type":"ContainerStarted","Data":"8b84f48bc7ab42e68e7be6d650884389cc41356fb95bfd9b5315de0dcf340298"}
Jul 30 22:41:52.944977 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.944932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:52.947050 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.947020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dcc645679-vndxt" event={"ID":"9a3ab9c9-e3c2-41ae-a3a4-c6356897e963","Type":"ContainerStarted","Data":"42ad98434edee735956ebf351e730105cb619c2f172f1b5bd41400e86cdd14e8"}
Jul 30 22:41:52.951329 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.951293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz"
Jul 30 22:41:52.972360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:52.972300    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj" podStartSLOduration=2.607200065 podStartE2EDuration="17.972276941s" totalImagesPullingTime="15.365076876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:52.970888921 +0000 UTC m=+94.236134861" watchObservedRunningTime="2026-07-30 22:41:52.972276941 +0000 UTC m=+94.237522871"
Jul 30 22:41:53.050537 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:53.050461    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.905510278 podStartE2EDuration="19.050432508s" totalImagesPullingTime="15.12727174s" totalInitContainerRuntime="17.65049ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:53.046704915 +0000 UTC m=+94.311950867" watchObservedRunningTime="2026-07-30 22:41:53.050432508 +0000 UTC m=+94.315678446"
Jul 30 22:41:53.050717 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:53.050672    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dcc645679-vndxt" podStartSLOduration=11.858871347000001 podStartE2EDuration="15.050660136s" totalImagesPullingTime="3.191788789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:53.001176596 +0000 UTC m=+94.266422536" watchObservedRunningTime="2026-07-30 22:41:53.050660136 +0000 UTC m=+94.315906074"
Jul 30 22:41:53.085184 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:53.085121    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-qvhhz" podStartSLOduration=11.920544033 podStartE2EDuration="15.085073108s" totalImagesPullingTime="3.164529075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:41:53.083526525 +0000 UTC m=+94.348772461" watchObservedRunningTime="2026-07-30 22:41:53.085073108 +0000 UTC m=+94.350319049"
Jul 30 22:41:53.959769 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:53.959737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78c48f87d7-8k8wj"
Jul 30 22:41:55.278251 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:55.278196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:55.278719 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:55.278292    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:55.283989 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:55.283959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:55.968658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:55.968624    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:41:56.034717 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:56.034679    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:41:56.439969 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:56.439929    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:41:58.469959 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:58.469914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:41:58.470476 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:41:58.469983    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:42:03.723113 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:03.723061    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cjcmz"
Jul 30 22:42:18.475957 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:18.475928    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:42:18.479971 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:18.479943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dcc645679-vndxt"
Jul 30 22:42:21.059059 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.058995    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bc87b555c-4tl4g" podUID="9986fc29-1046-46e1-97a9-adbc39e5518f" containerName="console" containerID="cri-o://3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d" gracePeriod=15
Jul 30 22:42:21.344787 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.344704    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:42:21.464952 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.464912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465161 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.464974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465161 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.464992    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465161 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465161 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465074    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465161 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sfhv\" (UniqueName: \"kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv\") pod \"9986fc29-1046-46e1-97a9-adbc39e5518f\" (UID: \"9986fc29-1046-46e1-97a9-adbc39e5518f\") "
Jul 30 22:42:21.465521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:21.465597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465523    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:21.465597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.465574    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config" (OuterVolumeSpecName: "console-config") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:21.467555 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.467523    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:21.467555 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.467543    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:21.467696 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.467600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv" (OuterVolumeSpecName: "kube-api-access-5sfhv") pod "9986fc29-1046-46e1-97a9-adbc39e5518f" (UID: "9986fc29-1046-46e1-97a9-adbc39e5518f"). InnerVolumeSpecName "kube-api-access-5sfhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:21.565958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565918    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-oauth-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:21.565958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565949    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:21.565958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565959    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-console-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:21.565958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565967    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9986fc29-1046-46e1-97a9-adbc39e5518f-oauth-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:21.566268 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565975    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sfhv\" (UniqueName: \"kubernetes.io/projected/9986fc29-1046-46e1-97a9-adbc39e5518f-kube-api-access-5sfhv\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:21.566268 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:21.565984    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9986fc29-1046-46e1-97a9-adbc39e5518f-console-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:22.079474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.079434    2559 generic.go:356] "Generic (PLEG): container finished" podID="9986fc29-1046-46e1-97a9-adbc39e5518f" containerID="3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d" exitCode=0
Jul 30 22:42:22.079867 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.079504    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc87b555c-4tl4g"
Jul 30 22:42:22.079867 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.079507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc87b555c-4tl4g" event={"ID":"9986fc29-1046-46e1-97a9-adbc39e5518f","Type":"ContainerDied","Data":"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"}
Jul 30 22:42:22.079867 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.079593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc87b555c-4tl4g" event={"ID":"9986fc29-1046-46e1-97a9-adbc39e5518f","Type":"ContainerDied","Data":"66b5f83b775885b52ff16fcad16d546a9d6c107805a82df7dc7adcf632b6eee1"}
Jul 30 22:42:22.079867 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.079616    2559 scope.go:117] "RemoveContainer" containerID="3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"
Jul 30 22:42:22.096123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.096071    2559 scope.go:117] "RemoveContainer" containerID="3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"
Jul 30 22:42:22.096456 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:22.096434    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d\": container with ID starting with 3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d not found: ID does not exist" containerID="3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"
Jul 30 22:42:22.096535 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.096466    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d"} err="failed to get container status \"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d\": rpc error: code = NotFound desc = could not find container \"3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d\": container with ID starting with 3f52fdd6f3ba9ddf832a5addd6034076219ceb8b8a0f9a01b9d4fe1bf242e26d not found: ID does not exist"
Jul 30 22:42:22.101230 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.101197    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:42:22.107205 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:22.107179    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc87b555c-4tl4g"]
Jul 30 22:42:23.239694 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:23.239659    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9986fc29-1046-46e1-97a9-adbc39e5518f" path="/var/lib/kubelet/pods/9986fc29-1046-46e1-97a9-adbc39e5518f/volumes"
Jul 30 22:42:54.191795 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.191758    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192088    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="alertmanager" containerID="cri-o://246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210" gracePeriod=120
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192152    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="prom-label-proxy" containerID="cri-o://63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73" gracePeriod=120
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192167    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-web" containerID="cri-o://ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75" gracePeriod=120
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192187    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-metric" containerID="cri-o://3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9" gracePeriod=120
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192192    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="config-reloader" containerID="cri-o://347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240" gracePeriod=120
Jul 30 22:42:54.192363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:54.192141    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy" containerID="cri-o://7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a" gracePeriod=120
Jul 30 22:42:55.219177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219142    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73" exitCode=0
Jul 30 22:42:55.219177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219166    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a" exitCode=0
Jul 30 22:42:55.219177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219172    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240" exitCode=0
Jul 30 22:42:55.219177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219177    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210" exitCode=0
Jul 30 22:42:55.219663 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"}
Jul 30 22:42:55.219663 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"}
Jul 30 22:42:55.219663 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"}
Jul 30 22:42:55.219663 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.219295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"}
Jul 30 22:42:55.444358 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.444326    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:55.558304 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558271    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558304 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558301    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558326    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558413    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558512    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558545    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf28c\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558919 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558919 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558617    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.558919 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.558667    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\" (UID: \"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b\") "
Jul 30 22:42:55.559259 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.559164    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:42:55.559586 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.559557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:55.559935 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.559911    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:42:55.561536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.561487    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume" (OuterVolumeSpecName: "config-volume") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.561646 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.561559    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out" (OuterVolumeSpecName: "config-out") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:42:55.561707 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.561670    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.561983 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.561954    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.562229 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.562193    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.563028 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.563002    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:55.563244 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.563220    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c" (OuterVolumeSpecName: "kube-api-access-xf28c") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "kube-api-access-xf28c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:42:55.563244 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.563227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.565830 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.565810    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.573081 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.573058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config" (OuterVolumeSpecName: "web-config") pod "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" (UID: "1416d022-4f0b-48b0-b3f1-a9424b3e2e4b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:42:55.659572 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659529    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-web-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659572 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659567    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-tls-assets\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659572 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659577    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659572 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659586    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-main-tls\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659596    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-volume\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659604    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-config-out\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659614    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-cluster-tls-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659622    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659632    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659640    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-metrics-client-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659648    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659656    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-alertmanager-main-db\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:55.659801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:55.659664    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf28c\" (UniqueName: \"kubernetes.io/projected/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b-kube-api-access-xf28c\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:42:56.226143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226086    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9" exitCode=0
Jul 30 22:42:56.226143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226128    2559 generic.go:356] "Generic (PLEG): container finished" podID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerID="ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75" exitCode=0
Jul 30 22:42:56.226143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"}
Jul 30 22:42:56.226668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226185    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.226668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"}
Jul 30 22:42:56.226668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1416d022-4f0b-48b0-b3f1-a9424b3e2e4b","Type":"ContainerDied","Data":"a31fd06e30befaeda5f61083ad230d57675cc3d40b5f029b1925a11666f05548"}
Jul 30 22:42:56.226668 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.226267    2559 scope.go:117] "RemoveContainer" containerID="63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"
Jul 30 22:42:56.234707 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.234688    2559 scope.go:117] "RemoveContainer" containerID="3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"
Jul 30 22:42:56.242071 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.242055    2559 scope.go:117] "RemoveContainer" containerID="7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"
Jul 30 22:42:56.249901 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.249481    2559 scope.go:117] "RemoveContainer" containerID="ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"
Jul 30 22:42:56.250977 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.250958    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:56.257323 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.257302    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:56.260666 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.260644    2559 scope.go:117] "RemoveContainer" containerID="347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"
Jul 30 22:42:56.267840 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.267821    2559 scope.go:117] "RemoveContainer" containerID="246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"
Jul 30 22:42:56.275355 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.275339    2559 scope.go:117] "RemoveContainer" containerID="ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"
Jul 30 22:42:56.283138 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283113    2559 scope.go:117] "RemoveContainer" containerID="63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"
Jul 30 22:42:56.283410 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.283391    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73\": container with ID starting with 63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73 not found: ID does not exist" containerID="63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"
Jul 30 22:42:56.283474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283420    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"} err="failed to get container status \"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73\": rpc error: code = NotFound desc = could not find container \"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73\": container with ID starting with 63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73 not found: ID does not exist"
Jul 30 22:42:56.283474 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283441    2559 scope.go:117] "RemoveContainer" containerID="3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"
Jul 30 22:42:56.283558 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283471    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:56.283711 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.283693    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9\": container with ID starting with 3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9 not found: ID does not exist" containerID="3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"
Jul 30 22:42:56.283752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283718    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"} err="failed to get container status \"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9\": rpc error: code = NotFound desc = could not find container \"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9\": container with ID starting with 3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9 not found: ID does not exist"
Jul 30 22:42:56.283752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283734    2559 scope.go:117] "RemoveContainer" containerID="7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"
Jul 30 22:42:56.283819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283773    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-web"
Jul 30 22:42:56.283819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283785    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-web"
Jul 30 22:42:56.283819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283795    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-metric"
Jul 30 22:42:56.283819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-metric"
Jul 30 22:42:56.283819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283813    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="config-reloader"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283821    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="config-reloader"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283840    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="prom-label-proxy"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283849    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="prom-label-proxy"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283869    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="alertmanager"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283876    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="alertmanager"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283883    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283890    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283897    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9986fc29-1046-46e1-97a9-adbc39e5518f" containerName="console"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283901    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9986fc29-1046-46e1-97a9-adbc39e5518f" containerName="console"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283908    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="init-config-reloader"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283913    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="init-config-reloader"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.283918    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a\": container with ID starting with 7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a not found: ID does not exist" containerID="7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283945    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"} err="failed to get container status \"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a\": rpc error: code = NotFound desc = could not find container \"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a\": container with ID starting with 7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a not found: ID does not exist"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283958    2559 scope.go:117] "RemoveContainer" containerID="ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.283959    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy"
Jul 30 22:42:56.283992 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284000    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9986fc29-1046-46e1-97a9-adbc39e5518f" containerName="console"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284010    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="prom-label-proxy"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284020    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-metric"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284025    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="alertmanager"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284031    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="config-reloader"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284042    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" containerName="kube-rbac-proxy-web"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.284246    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75\": container with ID starting with ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75 not found: ID does not exist" containerID="ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284274    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"} err="failed to get container status \"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75\": rpc error: code = NotFound desc = could not find container \"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75\": container with ID starting with ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75 not found: ID does not exist"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284295    2559 scope.go:117] "RemoveContainer" containerID="347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.284561    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240\": container with ID starting with 347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240 not found: ID does not exist" containerID="347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284581    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"} err="failed to get container status \"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240\": rpc error: code = NotFound desc = could not find container \"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240\": container with ID starting with 347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240 not found: ID does not exist"
Jul 30 22:42:56.284658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284596    2559 scope.go:117] "RemoveContainer" containerID="246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.284816    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210\": container with ID starting with 246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210 not found: ID does not exist" containerID="246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284835    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"} err="failed to get container status \"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210\": rpc error: code = NotFound desc = could not find container \"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210\": container with ID starting with 246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210 not found: ID does not exist"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.284855    2559 scope.go:117] "RemoveContainer" containerID="ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:42:56.285134    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4\": container with ID starting with ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4 not found: ID does not exist" containerID="ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285157    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"} err="failed to get container status \"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4\": rpc error: code = NotFound desc = could not find container \"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4\": container with ID starting with ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4 not found: ID does not exist"
Jul 30 22:42:56.285188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285174    2559 scope.go:117] "RemoveContainer" containerID="63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"
Jul 30 22:42:56.285439 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285420    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73"} err="failed to get container status \"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73\": rpc error: code = NotFound desc = could not find container \"63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73\": container with ID starting with 63fa3b55f18ae9e1feb459d7307e4ee5f4a275b9615963f3c32a3c278d10df73 not found: ID does not exist"
Jul 30 22:42:56.285489 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285440    2559 scope.go:117] "RemoveContainer" containerID="3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"
Jul 30 22:42:56.285717 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285700    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9"} err="failed to get container status \"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9\": rpc error: code = NotFound desc = could not find container \"3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9\": container with ID starting with 3758adbae44d4bcfb46b010755f18ff223f095c6f87ce69c1d6604c6261ff0d9 not found: ID does not exist"
Jul 30 22:42:56.285762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285717    2559 scope.go:117] "RemoveContainer" containerID="7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"
Jul 30 22:42:56.285966 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285949    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a"} err="failed to get container status \"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a\": rpc error: code = NotFound desc = could not find container \"7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a\": container with ID starting with 7b08f82ad046f64a4b14185e8c8a64e82efea07b90750b108c1460b019b23a0a not found: ID does not exist"
Jul 30 22:42:56.286007 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.285966    2559 scope.go:117] "RemoveContainer" containerID="ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"
Jul 30 22:42:56.286211 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286194    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75"} err="failed to get container status \"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75\": rpc error: code = NotFound desc = could not find container \"ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75\": container with ID starting with ef072b3f5d6c8aac6a097dba8c126da0eef4ac980c5a8c0b2047368b462a9b75 not found: ID does not exist"
Jul 30 22:42:56.286260 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286212    2559 scope.go:117] "RemoveContainer" containerID="347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"
Jul 30 22:42:56.286486 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286454    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240"} err="failed to get container status \"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240\": rpc error: code = NotFound desc = could not find container \"347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240\": container with ID starting with 347fa9048c534a16f76e08415073a211839c4c8deca089cb2af97ff5f9031240 not found: ID does not exist"
Jul 30 22:42:56.286486 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286474    2559 scope.go:117] "RemoveContainer" containerID="246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"
Jul 30 22:42:56.286769 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286748    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210"} err="failed to get container status \"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210\": rpc error: code = NotFound desc = could not find container \"246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210\": container with ID starting with 246aa0b5b270684c992a1d10dc487c0d182d45f20cbd755be45a335c7e4d2210 not found: ID does not exist"
Jul 30 22:42:56.286769 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286769    2559 scope.go:117] "RemoveContainer" containerID="ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"
Jul 30 22:42:56.287001 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.286981    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4"} err="failed to get container status \"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4\": rpc error: code = NotFound desc = could not find container \"ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4\": container with ID starting with ac7956e1565fbf92979b601a6af4012aff33ccda856776a80427e5a8796ce7f4 not found: ID does not exist"
Jul 30 22:42:56.288217 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.288203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.290751 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.290732    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 22:42:56.290843 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.290763    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 22:42:56.290843 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.290768    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 22:42:56.290843 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.290768    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 22:42:56.291081 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.291026    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 22:42:56.291081 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.291044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 22:42:56.291773 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.291329    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 22:42:56.291773 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.291524    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4rbb4\""
Jul 30 22:42:56.291773 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.291601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 22:42:56.295867 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.295851    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 22:42:56.309270 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.309235    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:56.365609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365609 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365801 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365902 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-config-out\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365902 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.365902 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.366002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-web-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.366002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.365979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.366072 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.366004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.366072 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.366018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.366170 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.366063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zkcc\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-kube-api-access-8zkcc\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.466870 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.466831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-web-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.466870 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.466873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467074 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.466902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467074 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.466923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467074 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkcc\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-kube-api-access-8zkcc\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467326 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467489 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-config-out\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.467940 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.467875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-web-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470536 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470534    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470804 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470804 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.470978 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.470961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.471262 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.471241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0a09533-f301-4726-baea-4a7d33b62b99-config-out\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.471349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.471328    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0a09533-f301-4726-baea-4a7d33b62b99-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.472410 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.472393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0a09533-f301-4726-baea-4a7d33b62b99-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.475143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.475122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkcc\" (UniqueName: \"kubernetes.io/projected/c0a09533-f301-4726-baea-4a7d33b62b99-kube-api-access-8zkcc\") pod \"alertmanager-main-0\" (UID: \"c0a09533-f301-4726-baea-4a7d33b62b99\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.599355 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.599303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:42:56.738712 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:56.738688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:42:56.740673 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:42:56.740643    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a09533_f301_4726_baea_4a7d33b62b99.slice/crio-69595979d3c50e307b3cf3e70e3ac67feed2ee7531f4fadf56f57a3644972ac3 WatchSource:0}: Error finding container 69595979d3c50e307b3cf3e70e3ac67feed2ee7531f4fadf56f57a3644972ac3: Status 404 returned error can't find the container with id 69595979d3c50e307b3cf3e70e3ac67feed2ee7531f4fadf56f57a3644972ac3
Jul 30 22:42:57.232318 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:57.232287    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0a09533-f301-4726-baea-4a7d33b62b99" containerID="ae2ab447ae9d9c7c3ca561c6c0eafbe4ee56a17558d47ce15d109123bc12a748" exitCode=0
Jul 30 22:42:57.232750 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:57.232329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerDied","Data":"ae2ab447ae9d9c7c3ca561c6c0eafbe4ee56a17558d47ce15d109123bc12a748"}
Jul 30 22:42:57.232750 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:57.232406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"69595979d3c50e307b3cf3e70e3ac67feed2ee7531f4fadf56f57a3644972ac3"}
Jul 30 22:42:57.239130 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:57.239080    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1416d022-4f0b-48b0-b3f1-a9424b3e2e4b" path="/var/lib/kubelet/pods/1416d022-4f0b-48b0-b3f1-a9424b3e2e4b/volumes"
Jul 30 22:42:58.241450 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"b1e16486a8d6d92c68cce419bd285986e688b521de9b160d717c9f27503eb396"}
Jul 30 22:42:58.241872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241491    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"9a18e4b277af233372a997caa721f70263bfadec6d80626d6435f7a6c5ca15f1"}
Jul 30 22:42:58.241872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"7cb0360bf0c6b19b593e7c9976a2dca2b6decc878be66d8adb8eec8c05da2637"}
Jul 30 22:42:58.241872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"f5a481f27d99e1c7a5a732a20039ebc3d22aef6e61fab72ae9de4d9446cfa485"}
Jul 30 22:42:58.241872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"1404d044ee1eddc312880dd6c99caee169d07f867d1a84ea10a9b97845fa8921"}
Jul 30 22:42:58.241872 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.241663    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0a09533-f301-4726-baea-4a7d33b62b99","Type":"ContainerStarted","Data":"cf48900eb62a269eb86d2343c0afacf1945ea9f202ef743ca6678d37cfac12e1"}
Jul 30 22:42:58.254032 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.253083    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-685f866dd5-6cwh5"]
Jul 30 22:42:58.256062 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.256039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.258918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.258651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 22:42:58.258918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.258653    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 22:42:58.258918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.258658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 22:42:58.259182 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.259014    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 22:42:58.259261 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.259243    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 22:42:58.259337 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.259321    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-b89pb\""
Jul 30 22:42:58.264297 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.264275    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 22:42:58.267003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.266973    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-685f866dd5-6cwh5"]
Jul 30 22:42:58.274400 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.274348    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.259191018 podStartE2EDuration="2.274333506s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.142488ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:42:58.273157223 +0000 UTC m=+159.538403161" watchObservedRunningTime="2026-07-30 22:42:58.274333506 +0000 UTC m=+159.539579443"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.384846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gtvq\" (UniqueName: \"kubernetes.io/projected/c537f07c-1a73-453c-bc19-435edd558989-kube-api-access-5gtvq\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.384900    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-serving-certs-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.384977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.385049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-metrics-client-ca\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.385249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-federate-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.385298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.385387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-telemeter-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.386123 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.385410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486347 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-telemeter-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486347 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gtvq\" (UniqueName: \"kubernetes.io/projected/c537f07c-1a73-453c-bc19-435edd558989-kube-api-access-5gtvq\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-serving-certs-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-metrics-client-ca\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-federate-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.486595 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.486497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.487318 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.487284    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-metrics-client-ca\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.487318 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.487305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-serving-certs-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.487525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.487408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c537f07c-1a73-453c-bc19-435edd558989-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.491176 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.491149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.491328 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.491196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.491328 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.491215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-federate-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.491507 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.491399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c537f07c-1a73-453c-bc19-435edd558989-telemeter-client-tls\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.494550 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.494524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gtvq\" (UniqueName: \"kubernetes.io/projected/c537f07c-1a73-453c-bc19-435edd558989-kube-api-access-5gtvq\") pod \"telemeter-client-685f866dd5-6cwh5\" (UID: \"c537f07c-1a73-453c-bc19-435edd558989\") " pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.572486 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.572445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5"
Jul 30 22:42:58.725646 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:58.725618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-685f866dd5-6cwh5"]
Jul 30 22:42:58.728212 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:42:58.728184    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc537f07c_1a73_453c_bc19_435edd558989.slice/crio-bc3bf3a25edf719b08ff88b06903037692b1fff2f996e75befe148b12f563d02 WatchSource:0}: Error finding container bc3bf3a25edf719b08ff88b06903037692b1fff2f996e75befe148b12f563d02: Status 404 returned error can't find the container with id bc3bf3a25edf719b08ff88b06903037692b1fff2f996e75befe148b12f563d02
Jul 30 22:42:59.246472 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:42:59.246435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5" event={"ID":"c537f07c-1a73-453c-bc19-435edd558989","Type":"ContainerStarted","Data":"bc3bf3a25edf719b08ff88b06903037692b1fff2f996e75befe148b12f563d02"}
Jul 30 22:43:01.257698 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.257662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5" event={"ID":"c537f07c-1a73-453c-bc19-435edd558989","Type":"ContainerStarted","Data":"8547bbfeca4c965d689e4f133d5d0578ddd4280bf541566462852428399fbdbd"}
Jul 30 22:43:01.258133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.257721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5" event={"ID":"c537f07c-1a73-453c-bc19-435edd558989","Type":"ContainerStarted","Data":"9845faa6df6c08512affe26433fb4a8dba1550c9aa01c945b1a8376d12726e91"}
Jul 30 22:43:01.258133 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.257739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5" event={"ID":"c537f07c-1a73-453c-bc19-435edd558989","Type":"ContainerStarted","Data":"ebdfa596464ad358920cff74b2158dd44f40af589b6f36c044053e30c0a8401e"}
Jul 30 22:43:01.281303 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.281248    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-685f866dd5-6cwh5" podStartSLOduration=1.238512666 podStartE2EDuration="3.281230579s" totalImagesPullingTime="2.042717913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:43:01.279689532 +0000 UTC m=+162.544935469" watchObservedRunningTime="2026-07-30 22:43:01.281230579 +0000 UTC m=+162.546476516"
Jul 30 22:43:01.356074 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.356038    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:43:01.358725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.358708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.369019 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.368994    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:43:01.513198 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513208    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513373 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xjr\" (UniqueName: \"kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.513521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.513437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614770 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614770 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xjr\" (UniqueName: \"kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.614979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.614951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.615618 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.615582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.615733 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.615651    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.615733 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.615696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.615938 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.615913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.617399 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.617373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.617513 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.617494    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.623475 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.623449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xjr\" (UniqueName: \"kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr\") pod \"console-76b45cdff4-tmnqz\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") " pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.668003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.667964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:01.799377 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:01.799349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:43:01.801963 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:43:01.801936    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd246f3_a987_41c9_8fce_1c10f9958928.slice/crio-e100c77a9697630e30ed361cacd3d26870ffb64fc42e4fcdb8e0492f7e531af8 WatchSource:0}: Error finding container e100c77a9697630e30ed361cacd3d26870ffb64fc42e4fcdb8e0492f7e531af8: Status 404 returned error can't find the container with id e100c77a9697630e30ed361cacd3d26870ffb64fc42e4fcdb8e0492f7e531af8
Jul 30 22:43:02.263825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:02.263785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b45cdff4-tmnqz" event={"ID":"bdd246f3-a987-41c9-8fce-1c10f9958928","Type":"ContainerStarted","Data":"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"}
Jul 30 22:43:02.264354 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:02.263837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b45cdff4-tmnqz" event={"ID":"bdd246f3-a987-41c9-8fce-1c10f9958928","Type":"ContainerStarted","Data":"e100c77a9697630e30ed361cacd3d26870ffb64fc42e4fcdb8e0492f7e531af8"}
Jul 30 22:43:02.280904 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:02.280840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b45cdff4-tmnqz" podStartSLOduration=1.280822311 podStartE2EDuration="1.280822311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:43:02.279790886 +0000 UTC m=+163.545036822" watchObservedRunningTime="2026-07-30 22:43:02.280822311 +0000 UTC m=+163.546068249"
Jul 30 22:43:11.668729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:11.668630    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:11.668729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:11.668706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:11.673622 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:11.673597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:12.308967 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:12.308934    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:43:12.355003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:12.354953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:43:37.380898 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.380857    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c457f4c78-lqwzv" podUID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" containerName="console" containerID="cri-o://634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007" gracePeriod=15
Jul 30 22:43:37.625916 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.625894    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:43:37.726822 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.726735    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rgxn\" (UniqueName: \"kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.726822 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.726782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.726832    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.726888    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727085 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727032    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727167 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727081    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727220 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727164    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config\") pod \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\" (UID: \"f5c27f05-d17a-4a68-941c-bc7dbb03f873\") "
Jul 30 22:43:37.727523 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca" (OuterVolumeSpecName: "service-ca") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:43:37.727523 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:43:37.727523 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727422    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:43:37.727523 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727491    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config" (OuterVolumeSpecName: "console-config") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:43:37.727748 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727644    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.727748 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727665    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-trusted-ca-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.727748 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727679    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-oauth-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.727748 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.727692    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.729130 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.729078    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:43:37.729239 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.729217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn" (OuterVolumeSpecName: "kube-api-access-7rgxn") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "kube-api-access-7rgxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:43:37.729284 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.729239    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f5c27f05-d17a-4a68-941c-bc7dbb03f873" (UID: "f5c27f05-d17a-4a68-941c-bc7dbb03f873"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:43:37.828869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.828841    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-oauth-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.828869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.828865    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rgxn\" (UniqueName: \"kubernetes.io/projected/f5c27f05-d17a-4a68-941c-bc7dbb03f873-kube-api-access-7rgxn\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:37.828869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:37.828874    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c27f05-d17a-4a68-941c-bc7dbb03f873-console-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:43:38.409068 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.409036    2559 generic.go:356] "Generic (PLEG): container finished" podID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" containerID="634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007" exitCode=0
Jul 30 22:43:38.409511 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.409080    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c457f4c78-lqwzv"
Jul 30 22:43:38.409511 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.409084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c457f4c78-lqwzv" event={"ID":"f5c27f05-d17a-4a68-941c-bc7dbb03f873","Type":"ContainerDied","Data":"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"}
Jul 30 22:43:38.409511 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.409144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c457f4c78-lqwzv" event={"ID":"f5c27f05-d17a-4a68-941c-bc7dbb03f873","Type":"ContainerDied","Data":"619acf50b3eab81f9f7f7d8b638ecd9674c967eb3bf14954714338a790fc1895"}
Jul 30 22:43:38.409511 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.409164    2559 scope.go:117] "RemoveContainer" containerID="634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"
Jul 30 22:43:38.420221 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.420197    2559 scope.go:117] "RemoveContainer" containerID="634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"
Jul 30 22:43:38.420565 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:43:38.420540    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007\": container with ID starting with 634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007 not found: ID does not exist" containerID="634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"
Jul 30 22:43:38.420683 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.420577    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007"} err="failed to get container status \"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007\": rpc error: code = NotFound desc = could not find container \"634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007\": container with ID starting with 634a782daffd472de5420298b0f4f12b2de81e799bc46f333ee39785986d9007 not found: ID does not exist"
Jul 30 22:43:38.431648 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.431622    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:43:38.434901 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:38.434880    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c457f4c78-lqwzv"]
Jul 30 22:43:39.239719 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:43:39.239689    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" path="/var/lib/kubelet/pods/f5c27f05-d17a-4a68-941c-bc7dbb03f873/volumes"
Jul 30 22:44:14.847084 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.847046    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:44:14.847581 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.847363    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" containerName="console"
Jul 30 22:44:14.847581 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.847374    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" containerName="console"
Jul 30 22:44:14.847581 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.847436    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c27f05-d17a-4a68-941c-bc7dbb03f873" containerName="console"
Jul 30 22:44:14.850296 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.850277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:14.863834 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:14.863808    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:44:15.023969 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.023920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.023992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.024023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.024047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.024066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024177 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.024167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.024376 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.024196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjnz\" (UniqueName: \"kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.125678 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.125678 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.125868 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.125868 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.125868 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126007 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.125975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126061 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.126011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjnz\" (UniqueName: \"kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126400 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.126374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.126436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126623 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.126571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.126792 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.126767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.128462 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.128442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.128462 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.128454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.134017 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.134000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjnz\" (UniqueName: \"kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz\") pod \"console-6fc4c4dc9-6b6jg\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") " pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.164089 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.164055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:15.296894 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.296816    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:44:15.299567 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:44:15.299538    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a73f640_2cdc_405a_85c8_cdf657a76ed9.slice/crio-c22741fd0f1a651ff2b57cbfe25f46d10b1c594ff5a9cf7ed77c2ece3718e339 WatchSource:0}: Error finding container c22741fd0f1a651ff2b57cbfe25f46d10b1c594ff5a9cf7ed77c2ece3718e339: Status 404 returned error can't find the container with id c22741fd0f1a651ff2b57cbfe25f46d10b1c594ff5a9cf7ed77c2ece3718e339
Jul 30 22:44:15.556882 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.556842    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc4c4dc9-6b6jg" event={"ID":"5a73f640-2cdc-405a-85c8-cdf657a76ed9","Type":"ContainerStarted","Data":"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"}
Jul 30 22:44:15.557053 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.556902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc4c4dc9-6b6jg" event={"ID":"5a73f640-2cdc-405a-85c8-cdf657a76ed9","Type":"ContainerStarted","Data":"c22741fd0f1a651ff2b57cbfe25f46d10b1c594ff5a9cf7ed77c2ece3718e339"}
Jul 30 22:44:15.575793 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:15.575745    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc4c4dc9-6b6jg" podStartSLOduration=1.575730258 podStartE2EDuration="1.575730258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:44:15.573814028 +0000 UTC m=+236.839059966" watchObservedRunningTime="2026-07-30 22:44:15.575730258 +0000 UTC m=+236.840976194"
Jul 30 22:44:25.164775 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:25.164732    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:25.165394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:25.164846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:25.169584 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:25.169561    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:25.605729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:25.605701    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:44:25.651485 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:25.651455    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:44:50.671643 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:50.671559    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76b45cdff4-tmnqz" podUID="bdd246f3-a987-41c9-8fce-1c10f9958928" containerName="console" containerID="cri-o://2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df" gracePeriod=15
Jul 30 22:44:50.911050 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:50.911025    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:44:51.029267 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029229    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029467 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029320    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2xjr\" (UniqueName: \"kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029467 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029355    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029467 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029388    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029467 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029442    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029662 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029471    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029662 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029504    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle\") pod \"bdd246f3-a987-41c9-8fce-1c10f9958928\" (UID: \"bdd246f3-a987-41c9-8fce-1c10f9958928\") "
Jul 30 22:44:51.029749 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029712    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config" (OuterVolumeSpecName: "console-config") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:44:51.029972 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029941    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:44:51.029972 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.029870    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca" (OuterVolumeSpecName: "service-ca") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:44:51.030400 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.030013    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:44:51.031653 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.031626    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:44:51.031746 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.031663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:44:51.031789 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.031762    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr" (OuterVolumeSpecName: "kube-api-access-v2xjr") pod "bdd246f3-a987-41c9-8fce-1c10f9958928" (UID: "bdd246f3-a987-41c9-8fce-1c10f9958928"). InnerVolumeSpecName "kube-api-access-v2xjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:44:51.130797 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130758    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2xjr\" (UniqueName: \"kubernetes.io/projected/bdd246f3-a987-41c9-8fce-1c10f9958928-kube-api-access-v2xjr\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.130797 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130787    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-oauth-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.130797 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130796    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.130797 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130805    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-oauth-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.131035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130813    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdd246f3-a987-41c9-8fce-1c10f9958928-console-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.131035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130822    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-trusted-ca-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.131035 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.130829    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdd246f3-a987-41c9-8fce-1c10f9958928-console-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:44:51.707229 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.707195    2559 generic.go:356] "Generic (PLEG): container finished" podID="bdd246f3-a987-41c9-8fce-1c10f9958928" containerID="2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df" exitCode=0
Jul 30 22:44:51.707602 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.707243    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b45cdff4-tmnqz"
Jul 30 22:44:51.707602 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.707284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b45cdff4-tmnqz" event={"ID":"bdd246f3-a987-41c9-8fce-1c10f9958928","Type":"ContainerDied","Data":"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"}
Jul 30 22:44:51.707602 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.707335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b45cdff4-tmnqz" event={"ID":"bdd246f3-a987-41c9-8fce-1c10f9958928","Type":"ContainerDied","Data":"e100c77a9697630e30ed361cacd3d26870ffb64fc42e4fcdb8e0492f7e531af8"}
Jul 30 22:44:51.707602 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.707358    2559 scope.go:117] "RemoveContainer" containerID="2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"
Jul 30 22:44:51.720119 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.720079    2559 scope.go:117] "RemoveContainer" containerID="2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"
Jul 30 22:44:51.720424 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:44:51.720405    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df\": container with ID starting with 2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df not found: ID does not exist" containerID="2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"
Jul 30 22:44:51.720475 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.720434    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df"} err="failed to get container status \"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df\": rpc error: code = NotFound desc = could not find container \"2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df\": container with ID starting with 2b7b8fe02895e984f5efffb6830d500a1a3420188966ee4d479847d1553e53df not found: ID does not exist"
Jul 30 22:44:51.724916 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.724893    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:44:51.727589 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:51.727566    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76b45cdff4-tmnqz"]
Jul 30 22:44:53.239719 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:53.239688    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd246f3-a987-41c9-8fce-1c10f9958928" path="/var/lib/kubelet/pods/bdd246f3-a987-41c9-8fce-1c10f9958928/volumes"
Jul 30 22:44:56.394900 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.394865    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"]
Jul 30 22:44:56.396023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.395995    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd246f3-a987-41c9-8fce-1c10f9958928" containerName="console"
Jul 30 22:44:56.396185 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.396173    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd246f3-a987-41c9-8fce-1c10f9958928" containerName="console"
Jul 30 22:44:56.396409 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.396397    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdd246f3-a987-41c9-8fce-1c10f9958928" containerName="console"
Jul 30 22:44:56.401382 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.401355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.403932 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.403912    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 22:44:56.405056 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.405032    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 22:44:56.405202 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.405042    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xbb64\""
Jul 30 22:44:56.407311 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.407288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"]
Jul 30 22:44:56.576851 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.576818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gxn6\" (UniqueName: \"kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.577049 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.576871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.577049 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.576928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.678397 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.678325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.678397 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.678355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.678590 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.678413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gxn6\" (UniqueName: \"kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.678737 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.678717    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.678791 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.678733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.687070 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.687038    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gxn6\" (UniqueName: \"kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.712086 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.712045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:44:56.849612 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:56.849580    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"]
Jul 30 22:44:56.852804 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:44:56.852762    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ed782f_d776_4aa3_a324_41c03d228bc3.slice/crio-76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971 WatchSource:0}: Error finding container 76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971: Status 404 returned error can't find the container with id 76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971
Jul 30 22:44:57.736862 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:44:57.736823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf" event={"ID":"c8ed782f-d776-4aa3-a324-41c03d228bc3","Type":"ContainerStarted","Data":"76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971"}
Jul 30 22:45:03.765185 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:03.765085    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerID="3b2ef06d6b6f2401f45239c064fe842728b2a5cd2808fdf359c17a9905e6e75f" exitCode=0
Jul 30 22:45:03.765185 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:03.765140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf" event={"ID":"c8ed782f-d776-4aa3-a324-41c03d228bc3","Type":"ContainerDied","Data":"3b2ef06d6b6f2401f45239c064fe842728b2a5cd2808fdf359c17a9905e6e75f"}
Jul 30 22:45:06.780496 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:06.780459    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerID="31c97e67ccf67d62c5fb4df20b9adee5249113bea02812569d22b3f9b3d99b01" exitCode=0
Jul 30 22:45:06.780784 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:06.780546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf" event={"ID":"c8ed782f-d776-4aa3-a324-41c03d228bc3","Type":"ContainerDied","Data":"31c97e67ccf67d62c5fb4df20b9adee5249113bea02812569d22b3f9b3d99b01"}
Jul 30 22:45:13.814352 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:13.814254    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerID="848b94f44667ab236e645abb431c39a6da61a8c3c4301b9948d87dd69e2df5f7" exitCode=0
Jul 30 22:45:13.814352 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:13.814315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf" event={"ID":"c8ed782f-d776-4aa3-a324-41c03d228bc3","Type":"ContainerDied","Data":"848b94f44667ab236e645abb431c39a6da61a8c3c4301b9948d87dd69e2df5f7"}
Jul 30 22:45:14.942116 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:14.942081    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:45:15.032521 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.032492    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle\") pod \"c8ed782f-d776-4aa3-a324-41c03d228bc3\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") "
Jul 30 22:45:15.032677 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.032529    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gxn6\" (UniqueName: \"kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6\") pod \"c8ed782f-d776-4aa3-a324-41c03d228bc3\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") "
Jul 30 22:45:15.032677 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.032578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util\") pod \"c8ed782f-d776-4aa3-a324-41c03d228bc3\" (UID: \"c8ed782f-d776-4aa3-a324-41c03d228bc3\") "
Jul 30 22:45:15.033265 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.033235    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle" (OuterVolumeSpecName: "bundle") pod "c8ed782f-d776-4aa3-a324-41c03d228bc3" (UID: "c8ed782f-d776-4aa3-a324-41c03d228bc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:15.034908 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.034874    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6" (OuterVolumeSpecName: "kube-api-access-5gxn6") pod "c8ed782f-d776-4aa3-a324-41c03d228bc3" (UID: "c8ed782f-d776-4aa3-a324-41c03d228bc3"). InnerVolumeSpecName "kube-api-access-5gxn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:45:15.036773 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.036751    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util" (OuterVolumeSpecName: "util") pod "c8ed782f-d776-4aa3-a324-41c03d228bc3" (UID: "c8ed782f-d776-4aa3-a324-41c03d228bc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:15.133676 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.133597    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:15.133676 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.133624    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8ed782f-d776-4aa3-a324-41c03d228bc3-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:15.133676 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.133634    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gxn6\" (UniqueName: \"kubernetes.io/projected/c8ed782f-d776-4aa3-a324-41c03d228bc3-kube-api-access-5gxn6\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:15.824677 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.824651    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf"
Jul 30 22:45:15.824825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.824682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwnpf" event={"ID":"c8ed782f-d776-4aa3-a324-41c03d228bc3","Type":"ContainerDied","Data":"76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971"}
Jul 30 22:45:15.824825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:15.824727    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76211fc39c074511c91111863a3191ba7046d50f589933220d5d0487a3950971"
Jul 30 22:45:19.139989 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.139955    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 22:45:19.320041 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.319908    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"]
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320250    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="util"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320261    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="util"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320290    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="extract"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320297    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="extract"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320313    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="pull"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320319    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="pull"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.320371    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ed782f-d776-4aa3-a324-41c03d228bc3" containerName="extract"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.344357    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"]
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.344448    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.347315    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.347363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.347316    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zlm5h\""
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.364313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655x8\" (UniqueName: \"kubernetes.io/projected/9b70d7f4-4096-4116-be63-d4093d15813b-kube-api-access-655x8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.364340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70d7f4-4096-4116-be63-d4093d15813b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.464776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655x8\" (UniqueName: \"kubernetes.io/projected/9b70d7f4-4096-4116-be63-d4093d15813b-kube-api-access-655x8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.464810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70d7f4-4096-4116-be63-d4093d15813b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.465178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70d7f4-4096-4116-be63-d4093d15813b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.472481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-655x8\" (UniqueName: \"kubernetes.io/projected/9b70d7f4-4096-4116-be63-d4093d15813b-kube-api-access-655x8\") pod \"cert-manager-operator-controller-manager-55c444bf86-hdbn9\" (UID: \"9b70d7f4-4096-4116-be63-d4093d15813b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.703669 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.653903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"
Jul 30 22:45:19.802502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.802477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9"]
Jul 30 22:45:19.805291 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:19.805263    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b70d7f4_4096_4116_be63_d4093d15813b.slice/crio-0531695fe0f025b9c306f8dc6b1cd6bd1629af0b6677b1326b295813d88cca43 WatchSource:0}: Error finding container 0531695fe0f025b9c306f8dc6b1cd6bd1629af0b6677b1326b295813d88cca43: Status 404 returned error can't find the container with id 0531695fe0f025b9c306f8dc6b1cd6bd1629af0b6677b1326b295813d88cca43
Jul 30 22:45:19.841985 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:19.841956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9" event={"ID":"9b70d7f4-4096-4116-be63-d4093d15813b","Type":"ContainerStarted","Data":"0531695fe0f025b9c306f8dc6b1cd6bd1629af0b6677b1326b295813d88cca43"}
Jul 30 22:45:21.854546 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:21.854506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9" event={"ID":"9b70d7f4-4096-4116-be63-d4093d15813b","Type":"ContainerStarted","Data":"94340e89d83e7390e1d91c33258bec83ebd2f1dfc89193a46114ecbbb6cbb9c7"}
Jul 30 22:45:21.873888 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:21.873833    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hdbn9" podStartSLOduration=0.960575409 podStartE2EDuration="2.87381859s" totalImagesPullingTime="1.913243181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:45:21.872554439 +0000 UTC m=+303.137800378" watchObservedRunningTime="2026-07-30 22:45:21.87381859 +0000 UTC m=+303.139064527"
Jul 30 22:45:23.205000 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.204961    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"]
Jul 30 22:45:23.207593 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.207574    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.210242 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.210217    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 22:45:23.210412 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.210218    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xbb64\""
Jul 30 22:45:23.210412 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.210278    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 22:45:23.217146 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.217115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"]
Jul 30 22:45:23.301445 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.301400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.301603 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.301529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9zx8\" (UniqueName: \"kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.301603 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.301566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.402952 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.402909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.402952 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.402957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9zx8\" (UniqueName: \"kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.403199 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.403082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.403362 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.403346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.403414 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.403375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.411085 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.411058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9zx8\" (UniqueName: \"kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.517396 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.517362    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:23.523569 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.522083    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9ltdw"]
Jul 30 22:45:23.524804 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.524782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.527400 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.527377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 22:45:23.527513 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.527375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-85rwl\""
Jul 30 22:45:23.527513 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.527412    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 22:45:23.535116 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.535069    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9ltdw"]
Jul 30 22:45:23.604865 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.604830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjs98\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-kube-api-access-rjs98\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.605020 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.604934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.652936 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.652905    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"]
Jul 30 22:45:23.655858 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:23.655803    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fe120b_2ee9_47a1_aca4_4bfc555962e0.slice/crio-b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136 WatchSource:0}: Error finding container b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136: Status 404 returned error can't find the container with id b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136
Jul 30 22:45:23.706371 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.706346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.706487 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.706414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjs98\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-kube-api-access-rjs98\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.714544 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.714523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.714642 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.714583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjs98\" (UniqueName: \"kubernetes.io/projected/7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8-kube-api-access-rjs98\") pod \"cert-manager-webhook-6486ffd997-9ltdw\" (UID: \"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.856291 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.856178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:23.865689 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.865660    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerID="7d69284c5570d5057d0c51a8b7ab663e507911f4a45fea65553998cd4c78d851" exitCode=0
Jul 30 22:45:23.865831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.865760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5" event={"ID":"b1fe120b-2ee9-47a1-aca4-4bfc555962e0","Type":"ContainerDied","Data":"7d69284c5570d5057d0c51a8b7ab663e507911f4a45fea65553998cd4c78d851"}
Jul 30 22:45:23.865831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.865803    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5" event={"ID":"b1fe120b-2ee9-47a1-aca4-4bfc555962e0","Type":"ContainerStarted","Data":"b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136"}
Jul 30 22:45:23.866717 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.866700    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:45:23.987287 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:23.987244    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9ltdw"]
Jul 30 22:45:23.989415 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:23.989390    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b999e6e_ce13_4cc4_baa4_1a4cfa5c3fc8.slice/crio-f783de1ba0fa2940ef32081ae8a035509cfa647c2fac36d5f270b4ab1e5a5528 WatchSource:0}: Error finding container f783de1ba0fa2940ef32081ae8a035509cfa647c2fac36d5f270b4ab1e5a5528: Status 404 returned error can't find the container with id f783de1ba0fa2940ef32081ae8a035509cfa647c2fac36d5f270b4ab1e5a5528
Jul 30 22:45:24.874264 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:24.874221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw" event={"ID":"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8","Type":"ContainerStarted","Data":"f783de1ba0fa2940ef32081ae8a035509cfa647c2fac36d5f270b4ab1e5a5528"}
Jul 30 22:45:27.891586 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:27.891545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw" event={"ID":"7b999e6e-ce13-4cc4-baa4-1a4cfa5c3fc8","Type":"ContainerStarted","Data":"5368484cec50f0a3d2a701e03c967e539d39049d627d0a15363a9e6c8bdef0c7"}
Jul 30 22:45:27.892089 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:27.891736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:27.893394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:27.893369    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerID="99d623f35e3a56f2ce09a28d123cb4ea71f8b53b686278382eeba83c32a11d93" exitCode=0
Jul 30 22:45:27.893530 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:27.893398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5" event={"ID":"b1fe120b-2ee9-47a1-aca4-4bfc555962e0","Type":"ContainerDied","Data":"99d623f35e3a56f2ce09a28d123cb4ea71f8b53b686278382eeba83c32a11d93"}
Jul 30 22:45:27.911270 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:27.911218    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw" podStartSLOduration=1.645836866 podStartE2EDuration="4.911198411s" totalImagesPullingTime="3.265361545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:45:27.90950521 +0000 UTC m=+309.174751148" watchObservedRunningTime="2026-07-30 22:45:27.911198411 +0000 UTC m=+309.176444348"
Jul 30 22:45:28.900402 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:28.900365    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerID="bfe854c26a581b80734bd0e97e35797cc9ef756eaa29387a4c7d3b6ec0b761f0" exitCode=0
Jul 30 22:45:28.900828 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:28.900462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5" event={"ID":"b1fe120b-2ee9-47a1-aca4-4bfc555962e0","Type":"ContainerDied","Data":"bfe854c26a581b80734bd0e97e35797cc9ef756eaa29387a4c7d3b6ec0b761f0"}
Jul 30 22:45:30.030543 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.030515    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:30.065596 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.065569    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util\") pod \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") "
Jul 30 22:45:30.065765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.065646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle\") pod \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") "
Jul 30 22:45:30.065765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.065688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9zx8\" (UniqueName: \"kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8\") pod \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\" (UID: \"b1fe120b-2ee9-47a1-aca4-4bfc555962e0\") "
Jul 30 22:45:30.066005 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.065973    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle" (OuterVolumeSpecName: "bundle") pod "b1fe120b-2ee9-47a1-aca4-4bfc555962e0" (UID: "b1fe120b-2ee9-47a1-aca4-4bfc555962e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:30.068013 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.067980    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8" (OuterVolumeSpecName: "kube-api-access-p9zx8") pod "b1fe120b-2ee9-47a1-aca4-4bfc555962e0" (UID: "b1fe120b-2ee9-47a1-aca4-4bfc555962e0"). InnerVolumeSpecName "kube-api-access-p9zx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:45:30.071897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.071871    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util" (OuterVolumeSpecName: "util") pod "b1fe120b-2ee9-47a1-aca4-4bfc555962e0" (UID: "b1fe120b-2ee9-47a1-aca4-4bfc555962e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:30.167188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.167083    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:30.167188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.167131    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:30.167188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.167141    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9zx8\" (UniqueName: \"kubernetes.io/projected/b1fe120b-2ee9-47a1-aca4-4bfc555962e0-kube-api-access-p9zx8\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:30.725176 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725134    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"]
Jul 30 22:45:30.725503 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725490    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="extract"
Jul 30 22:45:30.725503 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725504    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="extract"
Jul 30 22:45:30.725597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725520    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="pull"
Jul 30 22:45:30.725597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725525    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="pull"
Jul 30 22:45:30.725597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725536    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="util"
Jul 30 22:45:30.725597 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725543    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="util"
Jul 30 22:45:30.725752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.725599    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1fe120b-2ee9-47a1-aca4-4bfc555962e0" containerName="extract"
Jul 30 22:45:30.729022 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.729007    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.731697 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.731676    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mrzwh\""
Jul 30 22:45:30.736213 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.735713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"]
Jul 30 22:45:30.773138 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.773079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.773284 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.773144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndxp\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-kube-api-access-9ndxp\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.874027 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.873986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.874027 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.874029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndxp\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-kube-api-access-9ndxp\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.882586 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.882556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.882823 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.882800    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndxp\" (UniqueName: \"kubernetes.io/projected/09421d10-2370-4b79-bfec-3ce9c9fef825-kube-api-access-9ndxp\") pod \"cert-manager-cainjector-559cdd8c87-j8dmn\" (UID: \"09421d10-2370-4b79-bfec-3ce9c9fef825\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:30.911496 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.911462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5" event={"ID":"b1fe120b-2ee9-47a1-aca4-4bfc555962e0","Type":"ContainerDied","Data":"b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136"}
Jul 30 22:45:30.911496 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.911480    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2nqp5"
Jul 30 22:45:30.911695 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:30.911506    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b319316aa2ccabaee4e7ee2d7f7eb9830b621e82d48764ab51c6fa1b12725136"
Jul 30 22:45:31.038922 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:31.038891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"
Jul 30 22:45:31.170357 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:31.170330    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn"]
Jul 30 22:45:31.172735 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:31.172701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09421d10_2370_4b79_bfec_3ce9c9fef825.slice/crio-e8f9dfc4a7298b85874d58a43af314269a8dbd3620a47c0b6e6a063185b2fbd2 WatchSource:0}: Error finding container e8f9dfc4a7298b85874d58a43af314269a8dbd3620a47c0b6e6a063185b2fbd2: Status 404 returned error can't find the container with id e8f9dfc4a7298b85874d58a43af314269a8dbd3620a47c0b6e6a063185b2fbd2
Jul 30 22:45:31.918138 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:31.918080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn" event={"ID":"09421d10-2370-4b79-bfec-3ce9c9fef825","Type":"ContainerStarted","Data":"472b878a853faf536d72538051fe125460e8948e7ab16b1f1c5a23553a5c2d1d"}
Jul 30 22:45:31.918298 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:31.918148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn" event={"ID":"09421d10-2370-4b79-bfec-3ce9c9fef825","Type":"ContainerStarted","Data":"e8f9dfc4a7298b85874d58a43af314269a8dbd3620a47c0b6e6a063185b2fbd2"}
Jul 30 22:45:31.935694 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:31.935641    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j8dmn" podStartSLOduration=1.935621781 podStartE2EDuration="1.935621781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:45:31.935293555 +0000 UTC m=+313.200539492" watchObservedRunningTime="2026-07-30 22:45:31.935621781 +0000 UTC m=+313.200867716"
Jul 30 22:45:32.899410 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.899374    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zcj65"]
Jul 30 22:45:32.903055 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.903039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:32.905636 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.905620    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jw9g8\""
Jul 30 22:45:32.912002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.911981    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zcj65"]
Jul 30 22:45:32.992518 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.992485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-bound-sa-token\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:32.992671 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:32.992533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzchl\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-kube-api-access-bzchl\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.093523 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.093490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-bound-sa-token\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.093694 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.093531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzchl\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-kube-api-access-bzchl\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.101799 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.101768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-bound-sa-token\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.101896 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.101823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzchl\" (UniqueName: \"kubernetes.io/projected/a84ff93e-28ae-459a-8e96-cfa357dd62fd-kube-api-access-bzchl\") pod \"cert-manager-55b4d954d5-zcj65\" (UID: \"a84ff93e-28ae-459a-8e96-cfa357dd62fd\") " pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.212606 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.212538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zcj65"
Jul 30 22:45:33.340750 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.340728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zcj65"]
Jul 30 22:45:33.342848 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:33.342820    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda84ff93e_28ae_459a_8e96_cfa357dd62fd.slice/crio-80302d2afd2215b6f07b633f2f6a35220882c387f63d2cecc8dc7f0e8a6cdda2 WatchSource:0}: Error finding container 80302d2afd2215b6f07b633f2f6a35220882c387f63d2cecc8dc7f0e8a6cdda2: Status 404 returned error can't find the container with id 80302d2afd2215b6f07b633f2f6a35220882c387f63d2cecc8dc7f0e8a6cdda2
Jul 30 22:45:33.902869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.902844    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9ltdw"
Jul 30 22:45:33.930913 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.930872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zcj65" event={"ID":"a84ff93e-28ae-459a-8e96-cfa357dd62fd","Type":"ContainerStarted","Data":"ed98d84757b64ac4d995c47ea06fa2b55330546c0366dc5d391f3fc4b21b3b83"}
Jul 30 22:45:33.931040 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.930920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zcj65" event={"ID":"a84ff93e-28ae-459a-8e96-cfa357dd62fd","Type":"ContainerStarted","Data":"80302d2afd2215b6f07b633f2f6a35220882c387f63d2cecc8dc7f0e8a6cdda2"}
Jul 30 22:45:33.948628 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:33.948579    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zcj65" podStartSLOduration=1.9485644880000001 podStartE2EDuration="1.948564488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:45:33.946494506 +0000 UTC m=+315.211740444" watchObservedRunningTime="2026-07-30 22:45:33.948564488 +0000 UTC m=+315.213810426"
Jul 30 22:45:43.673901 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.673863    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"]
Jul 30 22:45:43.690283 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.690242    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"]
Jul 30 22:45:43.690283 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.690270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.693046 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.693029    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 22:45:43.693182 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.693032    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 22:45:43.694184 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.694162    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xbb64\""
Jul 30 22:45:43.792054 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.792016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4psbx\" (UniqueName: \"kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.792249 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.792083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.792249 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.792221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.892956 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.892919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.893130 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.892990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.893130 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.893014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4psbx\" (UniqueName: \"kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.893312 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.893292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.893349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.893331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:43.901163 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:43.901135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4psbx\" (UniqueName: \"kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:44.001114 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:44.001074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:44.152798 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:44.152748    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"]
Jul 30 22:45:44.154958 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:45:44.154928    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce05147_d9a3_4b00_95ab_528632f909fc.slice/crio-14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f WatchSource:0}: Error finding container 14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f: Status 404 returned error can't find the container with id 14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f
Jul 30 22:45:44.988394 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:44.988356    2559 generic.go:356] "Generic (PLEG): container finished" podID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerID="73488db533d4698048bbac9441a99d4756fb43e07e069d55a7357b7a9138f6b4" exitCode=0
Jul 30 22:45:44.988762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:44.988448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb" event={"ID":"0ce05147-d9a3-4b00-95ab-528632f909fc","Type":"ContainerDied","Data":"73488db533d4698048bbac9441a99d4756fb43e07e069d55a7357b7a9138f6b4"}
Jul 30 22:45:44.988762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:44.988500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb" event={"ID":"0ce05147-d9a3-4b00-95ab-528632f909fc","Type":"ContainerStarted","Data":"14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f"}
Jul 30 22:45:45.994973 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:45.994940    2559 generic.go:356] "Generic (PLEG): container finished" podID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerID="f76072296e31c87cf248537043cdc0f64e2230c825f949f11570d897284a32b4" exitCode=0
Jul 30 22:45:45.995369 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:45.995024    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb" event={"ID":"0ce05147-d9a3-4b00-95ab-528632f909fc","Type":"ContainerDied","Data":"f76072296e31c87cf248537043cdc0f64e2230c825f949f11570d897284a32b4"}
Jul 30 22:45:47.002333 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:47.002295    2559 generic.go:356] "Generic (PLEG): container finished" podID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerID="6183ca4c5b05db6ab5fe803ce47366e635fbb12d4a7f95250fdd786426bcb01d" exitCode=0
Jul 30 22:45:47.002731 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:47.002370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb" event={"ID":"0ce05147-d9a3-4b00-95ab-528632f909fc","Type":"ContainerDied","Data":"6183ca4c5b05db6ab5fe803ce47366e635fbb12d4a7f95250fdd786426bcb01d"}
Jul 30 22:45:48.131508 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.131487    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:48.229673 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.229646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4psbx\" (UniqueName: \"kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx\") pod \"0ce05147-d9a3-4b00-95ab-528632f909fc\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") "
Jul 30 22:45:48.229673 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.229685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle\") pod \"0ce05147-d9a3-4b00-95ab-528632f909fc\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") "
Jul 30 22:45:48.229909 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.229710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util\") pod \"0ce05147-d9a3-4b00-95ab-528632f909fc\" (UID: \"0ce05147-d9a3-4b00-95ab-528632f909fc\") "
Jul 30 22:45:48.230542 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.230506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle" (OuterVolumeSpecName: "bundle") pod "0ce05147-d9a3-4b00-95ab-528632f909fc" (UID: "0ce05147-d9a3-4b00-95ab-528632f909fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:48.231858 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.231833    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx" (OuterVolumeSpecName: "kube-api-access-4psbx") pod "0ce05147-d9a3-4b00-95ab-528632f909fc" (UID: "0ce05147-d9a3-4b00-95ab-528632f909fc"). InnerVolumeSpecName "kube-api-access-4psbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:45:48.235736 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.235705    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util" (OuterVolumeSpecName: "util") pod "0ce05147-d9a3-4b00-95ab-528632f909fc" (UID: "0ce05147-d9a3-4b00-95ab-528632f909fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:45:48.330505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.330442    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4psbx\" (UniqueName: \"kubernetes.io/projected/0ce05147-d9a3-4b00-95ab-528632f909fc-kube-api-access-4psbx\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:48.330505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.330464    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:48.330505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:48.330474    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce05147-d9a3-4b00-95ab-528632f909fc-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:45:49.015232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:49.015200    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb" event={"ID":"0ce05147-d9a3-4b00-95ab-528632f909fc","Type":"ContainerDied","Data":"14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f"}
Jul 30 22:45:49.015232 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:49.015229    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgvrvb"
Jul 30 22:45:49.015425 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:49.015250    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14c3e6da9de2e780f70f37f7b9da9eff430eeb0d7a0f929147608ea0737e537f"
Jul 30 22:45:59.961787 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.961756    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"]
Jul 30 22:45:59.962775 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.962756    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="util"
Jul 30 22:45:59.962885 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.962874    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="util"
Jul 30 22:45:59.962981 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.962965    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="pull"
Jul 30 22:45:59.963063 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.962990    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="pull"
Jul 30 22:45:59.963063 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.963014    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="extract"
Jul 30 22:45:59.963063 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.963022    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="extract"
Jul 30 22:45:59.963300 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.963177    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce05147-d9a3-4b00-95ab-528632f909fc" containerName="extract"
Jul 30 22:45:59.968136 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.968085    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:45:59.970840 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.970815    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 22:45:59.971037 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.971014    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 22:45:59.971183 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.971166    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 22:45:59.971252 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.971176    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jzx8w\""
Jul 30 22:45:59.971743 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.971724    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 22:45:59.982825 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:45:59.982798    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"]
Jul 30 22:46:00.133781 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.133755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.133991 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.133798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.133991 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.133914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.133991 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.133937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdrh\" (UniqueName: \"kubernetes.io/projected/98eb0ffc-9256-4d08-b708-8f3bd01c6678-kube-api-access-gfdrh\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.133991 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.133964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.234751 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.234709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.234942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.234751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdrh\" (UniqueName: \"kubernetes.io/projected/98eb0ffc-9256-4d08-b708-8f3bd01c6678-kube-api-access-gfdrh\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.234942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.234784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.234942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.234825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.234942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.234877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.235252 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.235230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-manifests\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.237233 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.237209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98eb0ffc-9256-4d08-b708-8f3bd01c6678-tmp\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.237318 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.237280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.237356 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.237334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98eb0ffc-9256-4d08-b708-8f3bd01c6678-webhook-cert\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.244578 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.244552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdrh\" (UniqueName: \"kubernetes.io/projected/98eb0ffc-9256-4d08-b708-8f3bd01c6678-kube-api-access-gfdrh\") pod \"opendatahub-operator-controller-manager-ff8c5f475-7s4z8\" (UID: \"98eb0ffc-9256-4d08-b708-8f3bd01c6678\") " pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.281257 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.281222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:00.432918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:00.432896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"]
Jul 30 22:46:00.435092 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:46:00.435059    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98eb0ffc_9256_4d08_b708_8f3bd01c6678.slice/crio-7a5c360bada0ea2dec44c1a68d96e1da2949154a04262794c678380d0b818008 WatchSource:0}: Error finding container 7a5c360bada0ea2dec44c1a68d96e1da2949154a04262794c678380d0b818008: Status 404 returned error can't find the container with id 7a5c360bada0ea2dec44c1a68d96e1da2949154a04262794c678380d0b818008
Jul 30 22:46:01.076184 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:01.076140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8" event={"ID":"98eb0ffc-9256-4d08-b708-8f3bd01c6678","Type":"ContainerStarted","Data":"7a5c360bada0ea2dec44c1a68d96e1da2949154a04262794c678380d0b818008"}
Jul 30 22:46:04.095360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:04.095323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8" event={"ID":"98eb0ffc-9256-4d08-b708-8f3bd01c6678","Type":"ContainerStarted","Data":"71a2071c65ced42ea6cd8323d5848d51076b9b9e4a25094564de6135bab6e37b"}
Jul 30 22:46:05.102280 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:05.102243    2559 generic.go:356] "Generic (PLEG): container finished" podID="98eb0ffc-9256-4d08-b708-8f3bd01c6678" containerID="71a2071c65ced42ea6cd8323d5848d51076b9b9e4a25094564de6135bab6e37b" exitCode=0
Jul 30 22:46:05.102656 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:05.102333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8" event={"ID":"98eb0ffc-9256-4d08-b708-8f3bd01c6678","Type":"ContainerDied","Data":"71a2071c65ced42ea6cd8323d5848d51076b9b9e4a25094564de6135bab6e37b"}
Jul 30 22:46:06.109091 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:06.109061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8" event={"ID":"98eb0ffc-9256-4d08-b708-8f3bd01c6678","Type":"ContainerStarted","Data":"20cb397f20fc40b2fe9d7b52bd2ce9b56b781c0ab92ea3574a328e6ed660f8ea"}
Jul 30 22:46:06.109490 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:06.109157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:06.134114 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:06.134042    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8" podStartSLOduration=2.742863665 podStartE2EDuration="7.13402477s" totalImagesPullingTime="3.306277704s" totalInitContainerRuntime="1.084883401s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:45:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:06.1316381 +0000 UTC m=+347.396884071" watchObservedRunningTime="2026-07-30 22:46:06.13402477 +0000 UTC m=+347.399270707"
Jul 30 22:46:17.115839 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:17.115769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-ff8c5f475-7s4z8"
Jul 30 22:46:19.857770 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.857735    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"]
Jul 30 22:46:19.863054 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.863033    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:19.868666 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.868641    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ljrjs\""
Jul 30 22:46:19.868796 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.868641    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 22:46:19.868796 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.868753    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 22:46:19.869172 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.869150    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 22:46:19.869280 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.869153    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 22:46:19.880516 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.880494    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"]
Jul 30 22:46:19.902198 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.902171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3992245-71c1-45a0-8a8e-106ccba4be34-tmp\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:19.902336 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.902296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6kxd\" (UniqueName: \"kubernetes.io/projected/c3992245-71c1-45a0-8a8e-106ccba4be34-kube-api-access-m6kxd\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:19.902392 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:19.902363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3992245-71c1-45a0-8a8e-106ccba4be34-tls-certs\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.003618 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.003587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3992245-71c1-45a0-8a8e-106ccba4be34-tmp\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.003780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.003696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6kxd\" (UniqueName: \"kubernetes.io/projected/c3992245-71c1-45a0-8a8e-106ccba4be34-kube-api-access-m6kxd\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.003780 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.003722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3992245-71c1-45a0-8a8e-106ccba4be34-tls-certs\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.005897 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.005868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3992245-71c1-45a0-8a8e-106ccba4be34-tmp\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.006250 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.006230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3992245-71c1-45a0-8a8e-106ccba4be34-tls-certs\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.034002 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.033975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6kxd\" (UniqueName: \"kubernetes.io/projected/c3992245-71c1-45a0-8a8e-106ccba4be34-kube-api-access-m6kxd\") pod \"kube-auth-proxy-b9c58d584-hdbzd\" (UID: \"c3992245-71c1-45a0-8a8e-106ccba4be34\") " pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.174213 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.174127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"
Jul 30 22:46:20.337156 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:20.337087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd"]
Jul 30 22:46:20.340217 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:46:20.340189    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3992245_71c1_45a0_8a8e_106ccba4be34.slice/crio-9559d51864fb388e2416b749cad3d6938e5a0f5c51e876629688c898f8927060 WatchSource:0}: Error finding container 9559d51864fb388e2416b749cad3d6938e5a0f5c51e876629688c898f8927060: Status 404 returned error can't find the container with id 9559d51864fb388e2416b749cad3d6938e5a0f5c51e876629688c898f8927060
Jul 30 22:46:21.176168 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.176134    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nx8mf"]
Jul 30 22:46:21.180371 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.180342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.184178 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.184148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 22:46:21.193337 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.193280    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd" event={"ID":"c3992245-71c1-45a0-8a8e-106ccba4be34","Type":"ContainerStarted","Data":"9559d51864fb388e2416b749cad3d6938e5a0f5c51e876629688c898f8927060"}
Jul 30 22:46:21.197447 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.197409    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nx8mf"]
Jul 30 22:46:21.317015 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.316978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6qgt\" (UniqueName: \"kubernetes.io/projected/89c9a38b-e853-4f19-8322-5e23d2ed4702-kube-api-access-l6qgt\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.317223 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.317049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.418712 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.418380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.418712 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.418524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6qgt\" (UniqueName: \"kubernetes.io/projected/89c9a38b-e853-4f19-8322-5e23d2ed4702-kube-api-access-l6qgt\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.418712 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:46:21.418619    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 22:46:21.418712 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:46:21.418693    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs podName:89c9a38b-e853-4f19-8322-5e23d2ed4702 nodeName:}" failed. No retries permitted until 2026-07-30 22:46:21.918671327 +0000 UTC m=+363.183917247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs") pod "model-serving-api-54d89bd5fc-nx8mf" (UID: "89c9a38b-e853-4f19-8322-5e23d2ed4702") : secret "model-serving-api-tls" not found
Jul 30 22:46:21.429841 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.429770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6qgt\" (UniqueName: \"kubernetes.io/projected/89c9a38b-e853-4f19-8322-5e23d2ed4702-kube-api-access-l6qgt\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.924930 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.924880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:21.928024 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:21.927992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89c9a38b-e853-4f19-8322-5e23d2ed4702-tls-certs\") pod \"model-serving-api-54d89bd5fc-nx8mf\" (UID: \"89c9a38b-e853-4f19-8322-5e23d2ed4702\") " pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:22.098155 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:22.098122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:22.851966 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:22.851938    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nx8mf"]
Jul 30 22:46:23.206865 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:23.206829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf" event={"ID":"89c9a38b-e853-4f19-8322-5e23d2ed4702","Type":"ContainerStarted","Data":"719b5a55b7e77bd935e5b4710272be6c1047c68adefcccd2bbb9f67e92d62521"}
Jul 30 22:46:23.208165 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:23.208129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd" event={"ID":"c3992245-71c1-45a0-8a8e-106ccba4be34","Type":"ContainerStarted","Data":"1ee881dd5707e44576e65f3ce712eff6ee8ee1ba51d199dd5255173a779016d6"}
Jul 30 22:46:23.226505 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:23.226462    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b9c58d584-hdbzd" podStartSLOduration=1.777554217 podStartE2EDuration="4.226447648s" totalImagesPullingTime="2.448893431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:23.225365774 +0000 UTC m=+364.490611734" watchObservedRunningTime="2026-07-30 22:46:23.226447648 +0000 UTC m=+364.491693584"
Jul 30 22:46:25.222385 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:25.222335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf" event={"ID":"89c9a38b-e853-4f19-8322-5e23d2ed4702","Type":"ContainerStarted","Data":"3f0d598cefdfc44ac6c2586722b3fc0ba072e9738a4c634e2b5937824008b9ef"}
Jul 30 22:46:25.222819 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:25.222431    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:25.241349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:25.241303    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf" podStartSLOduration=2.661589823 podStartE2EDuration="4.241288512s" totalImagesPullingTime="1.579698689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:25.241117803 +0000 UTC m=+366.506363784" watchObservedRunningTime="2026-07-30 22:46:25.241288512 +0000 UTC m=+366.506534447"
Jul 30 22:46:27.367918 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.367878    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"]
Jul 30 22:46:27.371477 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.371457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.375644 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:46:27.375752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375652    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 22:46:27.375752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375680    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 22:46:27.375752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 22:46:27.375752 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k5zm7\""
Jul 30 22:46:27.375908 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.375624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 22:46:27.381368 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.381349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"]
Jul 30 22:46:27.477416 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.477359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnltp\" (UniqueName: \"kubernetes.io/projected/47549563-ba06-420d-b22b-2bfabefc7a90-kube-api-access-fnltp\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.477618 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.477422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.477618 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.477477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.477618 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.477602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47549563-ba06-420d-b22b-2bfabefc7a90-manager-config\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.578674 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.578641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47549563-ba06-420d-b22b-2bfabefc7a90-manager-config\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.578833 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.578684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnltp\" (UniqueName: \"kubernetes.io/projected/47549563-ba06-420d-b22b-2bfabefc7a90-kube-api-access-fnltp\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.578869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.578839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.578900 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.578882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.579292 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.579265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47549563-ba06-420d-b22b-2bfabefc7a90-manager-config\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.581406 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.581383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.581502 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.581383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47549563-ba06-420d-b22b-2bfabefc7a90-metrics-cert\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.594686 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.594666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnltp\" (UniqueName: \"kubernetes.io/projected/47549563-ba06-420d-b22b-2bfabefc7a90-kube-api-access-fnltp\") pod \"lws-controller-manager-6c6cc5589b-7vqmc\" (UID: \"47549563-ba06-420d-b22b-2bfabefc7a90\") " pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.682028 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.681958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:27.824796 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:27.824743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"]
Jul 30 22:46:27.826855 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:46:27.826827    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47549563_ba06_420d_b22b_2bfabefc7a90.slice/crio-793904e2082e8ff94fdc7fa8e281db8ee23c17dd193f7b719adf3f46830289de WatchSource:0}: Error finding container 793904e2082e8ff94fdc7fa8e281db8ee23c17dd193f7b719adf3f46830289de: Status 404 returned error can't find the container with id 793904e2082e8ff94fdc7fa8e281db8ee23c17dd193f7b719adf3f46830289de
Jul 30 22:46:28.240475 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:28.240438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc" event={"ID":"47549563-ba06-420d-b22b-2bfabefc7a90","Type":"ContainerStarted","Data":"793904e2082e8ff94fdc7fa8e281db8ee23c17dd193f7b719adf3f46830289de"}
Jul 30 22:46:30.255412 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:30.255379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc" event={"ID":"47549563-ba06-420d-b22b-2bfabefc7a90","Type":"ContainerStarted","Data":"c3f3acc5da0fb2ca5028920bc3bdfae820492a91f6cb3f1677f5c39564986d59"}
Jul 30 22:46:30.255875 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:30.255452    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:36.231856 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:36.231824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nx8mf"
Jul 30 22:46:36.250067 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:36.250022    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc" podStartSLOduration=7.414956302 podStartE2EDuration="9.250006689s" totalImagesPullingTime="1.835050387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:30.303656873 +0000 UTC m=+371.568902811" watchObservedRunningTime="2026-07-30 22:46:36.250006689 +0000 UTC m=+377.515252629"
Jul 30 22:46:41.262305 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:41.262278    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c6cc5589b-7vqmc"
Jul 30 22:46:42.296603 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.296572    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78664495b8-s69bh"]
Jul 30 22:46:42.300281 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.300249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.312296 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.312266    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78664495b8-s69bh"]
Jul 30 22:46:42.411272 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411449 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2j8w\" (UniqueName: \"kubernetes.io/projected/80ed9575-5614-40ab-8bc3-bfbd869f2e22-kube-api-access-w2j8w\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411449 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-trusted-ca-bundle\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411570 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-service-ca\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411570 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411570 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-oauth-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.411705 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.411580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-oauth-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512366 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2j8w\" (UniqueName: \"kubernetes.io/projected/80ed9575-5614-40ab-8bc3-bfbd869f2e22-kube-api-access-w2j8w\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-trusted-ca-bundle\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-service-ca\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-oauth-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.512525 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.512519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-oauth-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.513301 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.513275    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-service-ca\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.513301 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.513293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-trusted-ca-bundle\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.513445 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.513343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.513520 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.513501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80ed9575-5614-40ab-8bc3-bfbd869f2e22-oauth-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.514990 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.514964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-oauth-config\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.515132 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.515062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80ed9575-5614-40ab-8bc3-bfbd869f2e22-console-serving-cert\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.520856 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.520833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2j8w\" (UniqueName: \"kubernetes.io/projected/80ed9575-5614-40ab-8bc3-bfbd869f2e22-kube-api-access-w2j8w\") pod \"console-78664495b8-s69bh\" (UID: \"80ed9575-5614-40ab-8bc3-bfbd869f2e22\") " pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.609122 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.609027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:42.743838 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:42.743813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78664495b8-s69bh"]
Jul 30 22:46:42.745573 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:46:42.745546    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ed9575_5614_40ab_8bc3_bfbd869f2e22.slice/crio-eb42dcae460dbcb628f9f61b650173fdfa032683686040d077b508e081681659 WatchSource:0}: Error finding container eb42dcae460dbcb628f9f61b650173fdfa032683686040d077b508e081681659: Status 404 returned error can't find the container with id eb42dcae460dbcb628f9f61b650173fdfa032683686040d077b508e081681659
Jul 30 22:46:43.325638 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:43.325607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78664495b8-s69bh" event={"ID":"80ed9575-5614-40ab-8bc3-bfbd869f2e22","Type":"ContainerStarted","Data":"8e7652f4a5a3ea8dda66704f60fe35743cdcca6b836b1be8892f8bb11dcf51fa"}
Jul 30 22:46:43.326018 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:43.325653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78664495b8-s69bh" event={"ID":"80ed9575-5614-40ab-8bc3-bfbd869f2e22","Type":"ContainerStarted","Data":"eb42dcae460dbcb628f9f61b650173fdfa032683686040d077b508e081681659"}
Jul 30 22:46:43.344395 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:43.344336    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78664495b8-s69bh" podStartSLOduration=1.344300245 podStartE2EDuration="1.344300245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:46:43.342046125 +0000 UTC m=+384.607292062" watchObservedRunningTime="2026-07-30 22:46:43.344300245 +0000 UTC m=+384.609546180"
Jul 30 22:46:52.609877 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:52.609839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:52.610274 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:52.609922    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:52.614571 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:52.614550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:53.377311 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:53.377279    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78664495b8-s69bh"
Jul 30 22:46:53.427294 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:46:53.427262    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:47:18.447228 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.447163    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fc4c4dc9-6b6jg" podUID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" containerName="console" containerID="cri-o://84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604" gracePeriod=15
Jul 30 22:47:18.698017 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.697956    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:47:18.833528 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833502    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833550    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbjnz\" (UniqueName: \"kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833570    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833590    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833628    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833651    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.833701 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config\") pod \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\" (UID: \"5a73f640-2cdc-405a-85c8-cdf657a76ed9\") "
Jul 30 22:47:18.834023 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.833995    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:47:18.834086 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.834039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:47:18.834203 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.834077    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:47:18.834357 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.834276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config" (OuterVolumeSpecName: "console-config") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 22:47:18.835758 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.835732    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz" (OuterVolumeSpecName: "kube-api-access-kbjnz") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "kube-api-access-kbjnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:47:18.835758 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.835753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:47:18.835896 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.835820    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a73f640-2cdc-405a-85c8-cdf657a76ed9" (UID: "5a73f640-2cdc-405a-85c8-cdf657a76ed9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:47:18.934631 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934608    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-oauth-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934631 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934628    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934637    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-trusted-ca-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934647    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbjnz\" (UniqueName: \"kubernetes.io/projected/5a73f640-2cdc-405a-85c8-cdf657a76ed9-kube-api-access-kbjnz\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934655    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-oauth-config\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934663    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a73f640-2cdc-405a-85c8-cdf657a76ed9-console-serving-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:18.934762 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:18.934671    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f640-2cdc-405a-85c8-cdf657a76ed9-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:19.515650 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.515569    2559 generic.go:356] "Generic (PLEG): container finished" podID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" containerID="84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604" exitCode=0
Jul 30 22:47:19.515650 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.515611    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc4c4dc9-6b6jg"
Jul 30 22:47:19.516080 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.515652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc4c4dc9-6b6jg" event={"ID":"5a73f640-2cdc-405a-85c8-cdf657a76ed9","Type":"ContainerDied","Data":"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"}
Jul 30 22:47:19.516080 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.515702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc4c4dc9-6b6jg" event={"ID":"5a73f640-2cdc-405a-85c8-cdf657a76ed9","Type":"ContainerDied","Data":"c22741fd0f1a651ff2b57cbfe25f46d10b1c594ff5a9cf7ed77c2ece3718e339"}
Jul 30 22:47:19.516080 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.515724    2559 scope.go:117] "RemoveContainer" containerID="84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"
Jul 30 22:47:19.524340 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.524325    2559 scope.go:117] "RemoveContainer" containerID="84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"
Jul 30 22:47:19.524625 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:47:19.524603    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604\": container with ID starting with 84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604 not found: ID does not exist" containerID="84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"
Jul 30 22:47:19.524693 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.524637    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604"} err="failed to get container status \"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604\": rpc error: code = NotFound desc = could not find container \"84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604\": container with ID starting with 84231aaec994dadf436e3afe3390b48b691f5d9363dfdd9608a05bfe207c3604 not found: ID does not exist"
Jul 30 22:47:19.538215 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.538195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:47:19.542759 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:19.542739    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc4c4dc9-6b6jg"]
Jul 30 22:47:21.240775 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:21.240738    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" path="/var/lib/kubelet/pods/5a73f640-2cdc-405a-85c8-cdf657a76ed9/volumes"
Jul 30 22:47:24.264329 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.264297    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"]
Jul 30 22:47:24.264790 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.264683    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" containerName="console"
Jul 30 22:47:24.264790 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.264694    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" containerName="console"
Jul 30 22:47:24.264869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.264804    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a73f640-2cdc-405a-85c8-cdf657a76ed9" containerName="console"
Jul 30 22:47:24.269655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.269635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.272555 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.272537    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 22:47:24.272634 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.272541    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 22:47:24.273634 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.273614    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xbb64\""
Jul 30 22:47:24.277655 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.277636    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"]
Jul 30 22:47:24.358172 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.358139    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"]
Jul 30 22:47:24.361870 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.361849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.371170 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.371144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"]
Jul 30 22:47:24.379552 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.379525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.379672 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.379655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.379796 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.379777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6sj\" (UniqueName: \"kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.466791 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.466757    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"]
Jul 30 22:47:24.470486 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.470469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.479881 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.479857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"]
Jul 30 22:47:24.480286 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.480360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.480360 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.480463 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.480463 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6sj\" (UniqueName: \"kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.480529 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v7jt\" (UniqueName: \"kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.480646 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.480680 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.480660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.494869 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.494840    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6sj\" (UniqueName: \"kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.561188 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.561113    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"]
Jul 30 22:47:24.565281 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.565261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.573461 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.573438    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"]
Jul 30 22:47:24.579915 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.579897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:24.581238 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.581319 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v7jt\" (UniqueName: \"kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.581319 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.581421 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xxn\" (UniqueName: \"kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.581421 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.581421 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.581654 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.581725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.581616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.590733 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.590709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v7jt\" (UniqueName: \"kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.672468 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.672442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:24.682175 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.682306 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.682306 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xxn\" (UniqueName: \"kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.682306 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.682466 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.682466 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttm5d\" (UniqueName: \"kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.684008 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.682937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.684008 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.683132    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.692837 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.692798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xxn\" (UniqueName: \"kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.724816 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.724702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"]
Jul 30 22:47:24.725293 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:47:24.725272    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd3cb8e_49fd_43ef_b843_fd0144458edf.slice/crio-1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a WatchSource:0}: Error finding container 1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a: Status 404 returned error can't find the container with id 1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a
Jul 30 22:47:24.789349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.789036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttm5d\" (UniqueName: \"kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.789349 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.789075    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:24.789559 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.789402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.789559 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.789446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.790336 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.789918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.791542 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.790456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.800876 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.800821    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttm5d\" (UniqueName: \"kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.844031 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.844006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"]
Jul 30 22:47:24.846955 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:47:24.846920    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d39e66_b084_4b17_8a1a_6e9eefc84f54.slice/crio-4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de WatchSource:0}: Error finding container 4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de: Status 404 returned error can't find the container with id 4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de
Jul 30 22:47:24.876210 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.876181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:24.950252 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:24.950221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"]
Jul 30 22:47:24.950599 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:47:24.950562    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c9bc06_1b2e_45c3_b342_92c2e4a1ab3e.slice/crio-b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3 WatchSource:0}: Error finding container b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3: Status 404 returned error can't find the container with id b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3
Jul 30 22:47:25.038376 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.038345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"]
Jul 30 22:47:25.112973 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:47:25.112910    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeac0750_dd3b_4e58_bb2b_9c51a8dbbc5c.slice/crio-770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0 WatchSource:0}: Error finding container 770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0: Status 404 returned error can't find the container with id 770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0
Jul 30 22:47:25.550619 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.550585    2559 generic.go:356] "Generic (PLEG): container finished" podID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerID="00ea7aa7fa87c74f624274c87a972661c563a8840424997ae8b6619edc80c52a" exitCode=0
Jul 30 22:47:25.551089 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.550678    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml" event={"ID":"81d39e66-b084-4b17-8a1a-6e9eefc84f54","Type":"ContainerDied","Data":"00ea7aa7fa87c74f624274c87a972661c563a8840424997ae8b6619edc80c52a"}
Jul 30 22:47:25.551089 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.550738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml" event={"ID":"81d39e66-b084-4b17-8a1a-6e9eefc84f54","Type":"ContainerStarted","Data":"4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de"}
Jul 30 22:47:25.552313 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.552286    2559 generic.go:356] "Generic (PLEG): container finished" podID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerID="9131dfb037555ae36db038c7be63f4eeaf084722e61d78b9f8832d10bde27c94" exitCode=0
Jul 30 22:47:25.552457 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.552362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw" event={"ID":"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e","Type":"ContainerDied","Data":"9131dfb037555ae36db038c7be63f4eeaf084722e61d78b9f8832d10bde27c94"}
Jul 30 22:47:25.552457 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.552416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw" event={"ID":"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e","Type":"ContainerStarted","Data":"b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3"}
Jul 30 22:47:25.554062 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.554041    2559 generic.go:356] "Generic (PLEG): container finished" podID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerID="48706f0454a0946a74eb7e9fba4e8f17536a860d49699c844262dba060ac2ffe" exitCode=0
Jul 30 22:47:25.554194 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.554133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv" event={"ID":"7cd3cb8e-49fd-43ef-b843-fd0144458edf","Type":"ContainerDied","Data":"48706f0454a0946a74eb7e9fba4e8f17536a860d49699c844262dba060ac2ffe"}
Jul 30 22:47:25.554194 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.554177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv" event={"ID":"7cd3cb8e-49fd-43ef-b843-fd0144458edf","Type":"ContainerStarted","Data":"1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a"}
Jul 30 22:47:25.555901 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.555872    2559 generic.go:356] "Generic (PLEG): container finished" podID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerID="e7c5fb3c62a2c020cda494e97166d2565dd0d708d527a42c56efc469afcfaf61" exitCode=0
Jul 30 22:47:25.555901 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.555893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq" event={"ID":"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c","Type":"ContainerDied","Data":"e7c5fb3c62a2c020cda494e97166d2565dd0d708d527a42c56efc469afcfaf61"}
Jul 30 22:47:25.556005 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:25.555926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq" event={"ID":"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c","Type":"ContainerStarted","Data":"770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0"}
Jul 30 22:47:26.563470 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:26.563427    2559 generic.go:356] "Generic (PLEG): container finished" podID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerID="de6e75d88e5dc2cba45434ac24f122491c5edde1d0033e672431358b64703feb" exitCode=0
Jul 30 22:47:26.563831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:26.563569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml" event={"ID":"81d39e66-b084-4b17-8a1a-6e9eefc84f54","Type":"ContainerDied","Data":"de6e75d88e5dc2cba45434ac24f122491c5edde1d0033e672431358b64703feb"}
Jul 30 22:47:27.571144 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.571077    2559 generic.go:356] "Generic (PLEG): container finished" podID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerID="7f0162d9a6f7956022b94418398628ca14dc5f560cf8943e6e287939b3bd5ba1" exitCode=0
Jul 30 22:47:27.571526 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.571167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml" event={"ID":"81d39e66-b084-4b17-8a1a-6e9eefc84f54","Type":"ContainerDied","Data":"7f0162d9a6f7956022b94418398628ca14dc5f560cf8943e6e287939b3bd5ba1"}
Jul 30 22:47:27.572870 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.572848    2559 generic.go:356] "Generic (PLEG): container finished" podID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerID="03e7f8a285987dfa057aaed6433563fb2f1b1551d3cddd83f242a7691499d3ca" exitCode=0
Jul 30 22:47:27.572988 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.572880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw" event={"ID":"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e","Type":"ContainerDied","Data":"03e7f8a285987dfa057aaed6433563fb2f1b1551d3cddd83f242a7691499d3ca"}
Jul 30 22:47:27.574786 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.574689    2559 generic.go:356] "Generic (PLEG): container finished" podID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerID="00d44ff63696eb6735c273f281c20dda2a504930a7b4ef888b49efc052e331fb" exitCode=0
Jul 30 22:47:27.574786 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.574711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv" event={"ID":"7cd3cb8e-49fd-43ef-b843-fd0144458edf","Type":"ContainerDied","Data":"00d44ff63696eb6735c273f281c20dda2a504930a7b4ef888b49efc052e331fb"}
Jul 30 22:47:27.576708 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.576689    2559 generic.go:356] "Generic (PLEG): container finished" podID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerID="1d36373ffc9ebf735dfb8f43aa0f90b7b0cc0d5f1ee684cef178abedf324ea3b" exitCode=0
Jul 30 22:47:27.576855 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:27.576763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq" event={"ID":"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c","Type":"ContainerDied","Data":"1d36373ffc9ebf735dfb8f43aa0f90b7b0cc0d5f1ee684cef178abedf324ea3b"}
Jul 30 22:47:28.584280 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.584248    2559 generic.go:356] "Generic (PLEG): container finished" podID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerID="51dd3ff1f247d6a1954e2868b0dd72149fb7fd6af0423745246dc1a1ace5e5ec" exitCode=0
Jul 30 22:47:28.584658 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.584338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw" event={"ID":"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e","Type":"ContainerDied","Data":"51dd3ff1f247d6a1954e2868b0dd72149fb7fd6af0423745246dc1a1ace5e5ec"}
Jul 30 22:47:28.586229 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.586206    2559 generic.go:356] "Generic (PLEG): container finished" podID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerID="332ee9deb750eba86c56cd91f1203b4fe102a3a7168ddd35db7b3aae7a6c0c62" exitCode=0
Jul 30 22:47:28.586323 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.586274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv" event={"ID":"7cd3cb8e-49fd-43ef-b843-fd0144458edf","Type":"ContainerDied","Data":"332ee9deb750eba86c56cd91f1203b4fe102a3a7168ddd35db7b3aae7a6c0c62"}
Jul 30 22:47:28.588010 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.587987    2559 generic.go:356] "Generic (PLEG): container finished" podID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerID="761b024714e7b7f7e6e306d4210f53c09d090c680b9854a247a49cd677c01509" exitCode=0
Jul 30 22:47:28.588143 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.588011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq" event={"ID":"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c","Type":"ContainerDied","Data":"761b024714e7b7f7e6e306d4210f53c09d090c680b9854a247a49cd677c01509"}
Jul 30 22:47:28.719346 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.719325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:28.826036 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.825956    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle\") pod \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") "
Jul 30 22:47:28.826036 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.826024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v7jt\" (UniqueName: \"kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt\") pod \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") "
Jul 30 22:47:28.826261 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.826092    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util\") pod \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\" (UID: \"81d39e66-b084-4b17-8a1a-6e9eefc84f54\") "
Jul 30 22:47:28.826477 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.826449    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle" (OuterVolumeSpecName: "bundle") pod "81d39e66-b084-4b17-8a1a-6e9eefc84f54" (UID: "81d39e66-b084-4b17-8a1a-6e9eefc84f54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:28.828121 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.828082    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt" (OuterVolumeSpecName: "kube-api-access-9v7jt") pod "81d39e66-b084-4b17-8a1a-6e9eefc84f54" (UID: "81d39e66-b084-4b17-8a1a-6e9eefc84f54"). InnerVolumeSpecName "kube-api-access-9v7jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:47:28.831438 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.831395    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util" (OuterVolumeSpecName: "util") pod "81d39e66-b084-4b17-8a1a-6e9eefc84f54" (UID: "81d39e66-b084-4b17-8a1a-6e9eefc84f54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:28.927606 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.927579    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:28.927606 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.927602    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v7jt\" (UniqueName: \"kubernetes.io/projected/81d39e66-b084-4b17-8a1a-6e9eefc84f54-kube-api-access-9v7jt\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:28.927749 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:28.927615    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d39e66-b084-4b17-8a1a-6e9eefc84f54-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:29.595522 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.595431    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml"
Jul 30 22:47:29.595522 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.595478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cr47ml" event={"ID":"81d39e66-b084-4b17-8a1a-6e9eefc84f54","Type":"ContainerDied","Data":"4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de"}
Jul 30 22:47:29.595986 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.595525    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c85a0bc7977581a50bc9916ed0fd091fd5666118921c0de4c1e10e4218871de"
Jul 30 22:47:29.749994 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.749965    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:29.797293 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.797274    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:29.800257 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.800237    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:47:29.938182 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util\") pod \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") "
Jul 30 22:47:29.938315 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938184    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj6sj\" (UniqueName: \"kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj\") pod \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") "
Jul 30 22:47:29.938315 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle\") pod \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") "
Jul 30 22:47:29.938315 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938258    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle\") pod \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") "
Jul 30 22:47:29.938315 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938288    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle\") pod \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") "
Jul 30 22:47:29.938315 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2xxn\" (UniqueName: \"kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn\") pod \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") "
Jul 30 22:47:29.938613 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util\") pod \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\" (UID: \"7cd3cb8e-49fd-43ef-b843-fd0144458edf\") "
Jul 30 22:47:29.938613 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util\") pod \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\" (UID: \"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e\") "
Jul 30 22:47:29.938613 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938457    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttm5d\" (UniqueName: \"kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d\") pod \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\" (UID: \"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c\") "
Jul 30 22:47:29.939179 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.938984    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle" (OuterVolumeSpecName: "bundle") pod "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" (UID: "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:29.939179 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.939013    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle" (OuterVolumeSpecName: "bundle") pod "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" (UID: "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:29.939512 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.939491    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle" (OuterVolumeSpecName: "bundle") pod "7cd3cb8e-49fd-43ef-b843-fd0144458edf" (UID: "7cd3cb8e-49fd-43ef-b843-fd0144458edf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:29.941382 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.941351    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj" (OuterVolumeSpecName: "kube-api-access-hj6sj") pod "7cd3cb8e-49fd-43ef-b843-fd0144458edf" (UID: "7cd3cb8e-49fd-43ef-b843-fd0144458edf"). InnerVolumeSpecName "kube-api-access-hj6sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:47:29.941493 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.941387    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn" (OuterVolumeSpecName: "kube-api-access-f2xxn") pod "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" (UID: "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e"). InnerVolumeSpecName "kube-api-access-f2xxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:47:29.941691 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.941663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d" (OuterVolumeSpecName: "kube-api-access-ttm5d") pod "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" (UID: "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c"). InnerVolumeSpecName "kube-api-access-ttm5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:47:29.945465 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.945440    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util" (OuterVolumeSpecName: "util") pod "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" (UID: "feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:29.945903 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.945881    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util" (OuterVolumeSpecName: "util") pod "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" (UID: "56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:29.955230 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:29.955207    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util" (OuterVolumeSpecName: "util") pod "7cd3cb8e-49fd-43ef-b843-fd0144458edf" (UID: "7cd3cb8e-49fd-43ef-b843-fd0144458edf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:47:30.039798 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039763    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.039798 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039793    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.039798 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039803    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2xxn\" (UniqueName: \"kubernetes.io/projected/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-kube-api-access-f2xxn\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039812    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cd3cb8e-49fd-43ef-b843-fd0144458edf-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039821    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039828    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttm5d\" (UniqueName: \"kubernetes.io/projected/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-kube-api-access-ttm5d\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039835    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c-util\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039843    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj6sj\" (UniqueName: \"kubernetes.io/projected/7cd3cb8e-49fd-43ef-b843-fd0144458edf-kube-api-access-hj6sj\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.040011 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.039851    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e-bundle\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:47:30.602734 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.602706    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq"
Jul 30 22:47:30.602734 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.602711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbcxcbq" event={"ID":"feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c","Type":"ContainerDied","Data":"770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0"}
Jul 30 22:47:30.603240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.602765    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="770b3f408219b108d2f479862c5beddd68e98d74493aec08ca88bb32dc9a6dc0"
Jul 30 22:47:30.604849 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.604828    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw"
Jul 30 22:47:30.604958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.604826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a08ptqw" event={"ID":"56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e","Type":"ContainerDied","Data":"b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3"}
Jul 30 22:47:30.604958 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.604950    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b14acfdf16d6baca6c590387ecbff239b22a24e5efd7a6a2f58c5f3a5d15f0a3"
Jul 30 22:47:30.606822 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.606803    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv" event={"ID":"7cd3cb8e-49fd-43ef-b843-fd0144458edf","Type":"ContainerDied","Data":"1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a"}
Jul 30 22:47:30.606900 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.606839    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b9ab4750551436f9e4a8e55b235a84c93d37c4f2324bcf8f05bfc7d4acccc7a"
Jul 30 22:47:30.606900 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:47:30.606860    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053rm4vv"
Jul 30 22:48:44.107244 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107209    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107601    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="extract"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107613    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="extract"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107624    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107632    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107643    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="extract"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107649    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="extract"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107666    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107671    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107677    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107682    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107688    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107692    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107697    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107701    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="pull"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107725    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107730    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="util"
Jul 30 22:48:44.107725 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107735    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="util"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107742    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107760    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107765    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107774    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="pull"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107779    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="pull"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd3cb8e-49fd-43ef-b843-fd0144458edf" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107851    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d39e66-b084-4b17-8a1a-6e9eefc84f54" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="feac0750-dd3b-4e58-bb2b-9c51a8dbbc5c" containerName="extract"
Jul 30 22:48:44.108372 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.107862    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="56c9bc06-1b2e-45c3-b342-92c2e4a1ab3e" containerName="extract"
Jul 30 22:48:44.110842 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.110827    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.113688 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.113666    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 22:48:44.113844 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.113796    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x69mt\""
Jul 30 22:48:44.114649 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.114633    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 22:48:44.114740 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.114654    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 22:48:44.127534 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.127512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:48:44.159645 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.159618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:48:44.231250 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.231222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b5b355c-9750-439a-bacc-14f161615764-config-file\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.231431 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.231268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k926l\" (UniqueName: \"kubernetes.io/projected/2b5b355c-9750-439a-bacc-14f161615764-kube-api-access-k926l\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.331953 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.331920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b5b355c-9750-439a-bacc-14f161615764-config-file\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.332140 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.331968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k926l\" (UniqueName: \"kubernetes.io/projected/2b5b355c-9750-439a-bacc-14f161615764-kube-api-access-k926l\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.332557 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.332539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b5b355c-9750-439a-bacc-14f161615764-config-file\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.341221 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.341196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k926l\" (UniqueName: \"kubernetes.io/projected/2b5b355c-9750-439a-bacc-14f161615764-kube-api-access-k926l\") pod \"limitador-limitador-85d9db4d5d-xbgpz\" (UID: \"2b5b355c-9750-439a-bacc-14f161615764\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.421337 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.421267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:44.561052 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.561023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:48:44.562629 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:48:44.562610    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5b355c_9750_439a_bacc_14f161615764.slice/crio-f391bd216e2c29e1c63de1a5df6487a6b53daf633343fb9f0d64cf7c642739b3 WatchSource:0}: Error finding container f391bd216e2c29e1c63de1a5df6487a6b53daf633343fb9f0d64cf7c642739b3: Status 404 returned error can't find the container with id f391bd216e2c29e1c63de1a5df6487a6b53daf633343fb9f0d64cf7c642739b3
Jul 30 22:48:44.763706 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.763675    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:48:44.768219 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.768202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:48:44.773458 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.773434    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6lx46\""
Jul 30 22:48:44.783240 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.782600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:48:44.938409 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:44.938374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln654\" (UniqueName: \"kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654\") pod \"authorino-c548b5d7d-xn7bd\" (UID: \"1e0cb4cd-b91d-4781-9b8f-7dc00acef014\") " pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:48:45.026267 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:45.026186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz" event={"ID":"2b5b355c-9750-439a-bacc-14f161615764","Type":"ContainerStarted","Data":"f391bd216e2c29e1c63de1a5df6487a6b53daf633343fb9f0d64cf7c642739b3"}
Jul 30 22:48:45.039639 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:45.039614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln654\" (UniqueName: \"kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654\") pod \"authorino-c548b5d7d-xn7bd\" (UID: \"1e0cb4cd-b91d-4781-9b8f-7dc00acef014\") " pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:48:45.058843 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:45.058811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln654\" (UniqueName: \"kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654\") pod \"authorino-c548b5d7d-xn7bd\" (UID: \"1e0cb4cd-b91d-4781-9b8f-7dc00acef014\") " pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:48:45.085682 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:45.085653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:48:45.230672 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:45.230639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:48:45.233263 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:48:45.233214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e0cb4cd_b91d_4781_9b8f_7dc00acef014.slice/crio-318443b9ffac3d11ce50633674c9002c5caf774fb313325648ebc6d944d60886 WatchSource:0}: Error finding container 318443b9ffac3d11ce50633674c9002c5caf774fb313325648ebc6d944d60886: Status 404 returned error can't find the container with id 318443b9ffac3d11ce50633674c9002c5caf774fb313325648ebc6d944d60886
Jul 30 22:48:46.035415 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:46.035332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" event={"ID":"1e0cb4cd-b91d-4781-9b8f-7dc00acef014","Type":"ContainerStarted","Data":"318443b9ffac3d11ce50633674c9002c5caf774fb313325648ebc6d944d60886"}
Jul 30 22:48:48.049812 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:48.049777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz" event={"ID":"2b5b355c-9750-439a-bacc-14f161615764","Type":"ContainerStarted","Data":"257e056f8e6356f1e3cb7ed4f517ed75ceaaaa27820de27954502241c0ac2005"}
Jul 30 22:48:48.050256 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:48.049894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:48:48.051401 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:48.051377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" event={"ID":"1e0cb4cd-b91d-4781-9b8f-7dc00acef014","Type":"ContainerStarted","Data":"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"}
Jul 30 22:48:48.069968 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:48.069911    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz" podStartSLOduration=1.288068762 podStartE2EDuration="4.069895166s" totalImagesPullingTime="2.781826404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.068058857 +0000 UTC m=+509.333304811" watchObservedRunningTime="2026-07-30 22:48:48.069895166 +0000 UTC m=+509.335141102"
Jul 30 22:48:48.083248 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:48.083196    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" podStartSLOduration=1.966707932 podStartE2EDuration="4.083181512s" totalImagesPullingTime="2.11647358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.081235029 +0000 UTC m=+509.346480968" watchObservedRunningTime="2026-07-30 22:48:48.083181512 +0000 UTC m=+509.348427480"
Jul 30 22:48:59.057853 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:48:59.057817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"
Jul 30 22:49:14.202979 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.202908    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-f8jlr"]
Jul 30 22:49:14.206178 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.206157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.209318 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.209299    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 22:49:14.222069 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.222043    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-f8jlr"]
Jul 30 22:49:14.266827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.266795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.266941 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.266838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787ds\" (UniqueName: \"kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.278757 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.278727    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-f8jlr"]
Jul 30 22:49:14.278974 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:49:14.278956    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-787ds tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-f8jlr" podUID="e811a2c8-5e62-4ae6-b081-8f2085c4b262"
Jul 30 22:49:14.367426 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.367398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.367542 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.367441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787ds\" (UniqueName: \"kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.369927 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.369904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:14.379425 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:14.379405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-787ds\" (UniqueName: \"kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds\") pod \"authorino-687bd45585-f8jlr\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") " pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:15.190574 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.190546    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:15.198255 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.198233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:15.273213 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.273180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert\") pod \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") "
Jul 30 22:49:15.273709 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.273276    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-787ds\" (UniqueName: \"kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds\") pod \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\" (UID: \"e811a2c8-5e62-4ae6-b081-8f2085c4b262\") "
Jul 30 22:49:15.275485 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.275460    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e811a2c8-5e62-4ae6-b081-8f2085c4b262" (UID: "e811a2c8-5e62-4ae6-b081-8f2085c4b262"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:49:15.275582 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.275549    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds" (OuterVolumeSpecName: "kube-api-access-787ds") pod "e811a2c8-5e62-4ae6-b081-8f2085c4b262" (UID: "e811a2c8-5e62-4ae6-b081-8f2085c4b262"). InnerVolumeSpecName "kube-api-access-787ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:49:15.375058 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.375016    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-787ds\" (UniqueName: \"kubernetes.io/projected/e811a2c8-5e62-4ae6-b081-8f2085c4b262-kube-api-access-787ds\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:49:15.375058 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:15.375050    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e811a2c8-5e62-4ae6-b081-8f2085c4b262-tls-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:49:16.195264 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.195235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-f8jlr"
Jul 30 22:49:16.240429 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.240391    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-f8jlr"]
Jul 30 22:49:16.242464 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.242439    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-f8jlr"]
Jul 30 22:49:16.514290 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.514252    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:49:16.514729 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.514475    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" podUID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" containerName="authorino" containerID="cri-o://852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08" gracePeriod=30
Jul 30 22:49:16.757997 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.757974    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:49:16.789003 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.788924    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln654\" (UniqueName: \"kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654\") pod \"1e0cb4cd-b91d-4781-9b8f-7dc00acef014\" (UID: \"1e0cb4cd-b91d-4781-9b8f-7dc00acef014\") "
Jul 30 22:49:16.791169 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.791143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654" (OuterVolumeSpecName: "kube-api-access-ln654") pod "1e0cb4cd-b91d-4781-9b8f-7dc00acef014" (UID: "1e0cb4cd-b91d-4781-9b8f-7dc00acef014"). InnerVolumeSpecName "kube-api-access-ln654". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:49:16.889978 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:16.889943    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln654\" (UniqueName: \"kubernetes.io/projected/1e0cb4cd-b91d-4781-9b8f-7dc00acef014-kube-api-access-ln654\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 22:49:17.201632 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.201535    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" containerID="852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08" exitCode=0
Jul 30 22:49:17.201632 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.201585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" event={"ID":"1e0cb4cd-b91d-4781-9b8f-7dc00acef014","Type":"ContainerDied","Data":"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"}
Jul 30 22:49:17.201632 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.201591    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xn7bd"
Jul 30 22:49:17.201632 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.201614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xn7bd" event={"ID":"1e0cb4cd-b91d-4781-9b8f-7dc00acef014","Type":"ContainerDied","Data":"318443b9ffac3d11ce50633674c9002c5caf774fb313325648ebc6d944d60886"}
Jul 30 22:49:17.201632 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.201630    2559 scope.go:117] "RemoveContainer" containerID="852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"
Jul 30 22:49:17.210942 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.210925    2559 scope.go:117] "RemoveContainer" containerID="852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"
Jul 30 22:49:17.211206 ip-10-0-143-234 kubenswrapper[2559]: E0730 22:49:17.211186    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08\": container with ID starting with 852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08 not found: ID does not exist" containerID="852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"
Jul 30 22:49:17.211267 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.211216    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08"} err="failed to get container status \"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08\": rpc error: code = NotFound desc = could not find container \"852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08\": container with ID starting with 852ec2b1cb7db05910d3d1fa5474c2ed626fe6278d3c1b7522b25975f2422d08 not found: ID does not exist"
Jul 30 22:49:17.241055 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.241017    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e811a2c8-5e62-4ae6-b081-8f2085c4b262" path="/var/lib/kubelet/pods/e811a2c8-5e62-4ae6-b081-8f2085c4b262/volumes"
Jul 30 22:49:17.241233 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.241215    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:49:17.241953 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:17.241929    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xn7bd"]
Jul 30 22:49:19.240551 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:19.240521    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" path="/var/lib/kubelet/pods/1e0cb4cd-b91d-4781-9b8f-7dc00acef014/volumes"
Jul 30 22:49:57.003634 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:49:57.003596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:50:25.604257 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:50:25.604223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:50:31.613808 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:50:31.613774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:50:39.400860 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:50:39.400832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:50:54.203757 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:50:54.203721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:51:11.605914 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:51:11.605879    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:51:22.805803 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:51:22.805767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:52:12.477256 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.477180    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7454bb44fc-9wfmk"]
Jul 30 22:52:12.477756 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.477648    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" containerName="authorino"
Jul 30 22:52:12.477756 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.477665    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" containerName="authorino"
Jul 30 22:52:12.477756 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.477738    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e0cb4cd-b91d-4781-9b8f-7dc00acef014" containerName="authorino"
Jul 30 22:52:12.480666 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.480650    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.484253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.484233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 22:52:12.484253 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.484237    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6lx46\""
Jul 30 22:52:12.492313 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.492292    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7454bb44fc-9wfmk"]
Jul 30 22:52:12.612853 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.612827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-tls-cert\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.612853 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.612856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97nd\" (UniqueName: \"kubernetes.io/projected/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-kube-api-access-l97nd\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.713830 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.713802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-tls-cert\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.713963 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.713835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97nd\" (UniqueName: \"kubernetes.io/projected/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-kube-api-access-l97nd\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.716277 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.716256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-tls-cert\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.722594 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.722568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97nd\" (UniqueName: \"kubernetes.io/projected/b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c-kube-api-access-l97nd\") pod \"authorino-7454bb44fc-9wfmk\" (UID: \"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c\") " pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.789438 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.789399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7454bb44fc-9wfmk"
Jul 30 22:52:12.923281 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.923257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7454bb44fc-9wfmk"]
Jul 30 22:52:12.924719 ip-10-0-143-234 kubenswrapper[2559]: W0730 22:52:12.924689    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5c8d8bf_0fc2_4176_9dc9_6e5ab00c108c.slice/crio-72968c31dc94d17ee57f06ae35d84d726fb129ac4d76cf84dc75a8d5f4cc5f40 WatchSource:0}: Error finding container 72968c31dc94d17ee57f06ae35d84d726fb129ac4d76cf84dc75a8d5f4cc5f40: Status 404 returned error can't find the container with id 72968c31dc94d17ee57f06ae35d84d726fb129ac4d76cf84dc75a8d5f4cc5f40
Jul 30 22:52:12.925984 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:12.925966    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:52:13.110765 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:13.110685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7454bb44fc-9wfmk" event={"ID":"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c","Type":"ContainerStarted","Data":"72968c31dc94d17ee57f06ae35d84d726fb129ac4d76cf84dc75a8d5f4cc5f40"}
Jul 30 22:52:14.119478 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:14.119439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7454bb44fc-9wfmk" event={"ID":"b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c","Type":"ContainerStarted","Data":"20ae10f923e373a951cbd8f2804234f50bced0bf70bb18924b11fa9fc0718465"}
Jul 30 22:52:14.152163 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:14.152087    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7454bb44fc-9wfmk" podStartSLOduration=1.386241541 podStartE2EDuration="2.152069008s" totalImagesPullingTime="765.827467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:14.148625421 +0000 UTC m=+715.413871363" watchObservedRunningTime="2026-07-30 22:52:14.152069008 +0000 UTC m=+715.417314945"
Jul 30 22:52:44.900190 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:44.900147    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:52:54.795734 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:52:54.795694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:53:06.196363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:53:06.196318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:54:46.599363 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:54:46.599319    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:54:56.001387 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:54:56.001349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:55:54.798217 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:55:54.798183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:01.890475 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:01.890440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:17.598827 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:17.598793    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:23.699617 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:23.699584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:32.905904 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:32.905864    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:40.401007 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:40.400911    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:53.730562 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:53.730524    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:56:59.302771 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:56:59.302738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:57:06.988831 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:57:06.988794    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:57:12.997243 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:57:12.997212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:57:26.094348 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:57:26.094307    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:57:36.400863 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:57:36.400825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:57:59.005718 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:57:59.005676    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:09.689829 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:09.689738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:14.695883 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:14.695845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:22.898227 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:22.898190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:30.401470 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:30.401436    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:35.489806 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:35.489773    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:41.298844 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:41.298807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:58:48.503954 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:58:48.503914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:00.297522 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:00.297472    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:08.001980 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:08.001944    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:18.391497 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:18.391458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:23.594601 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:23.594562    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:29.706966 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:29.706916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:38.895446 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:38.895408    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:43.991172 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:43.991073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 22:59:54.900219 ip-10-0-143-234 kubenswrapper[2559]: I0730 22:59:54.900178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:00:00.147329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.147292    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"]
Jul 30 23:00:00.150804 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.150788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"
Jul 30 23:00:00.153324 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.153300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:00:00.160077 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.160060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"
Jul 30 23:00:00.166452 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.166429    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"]
Jul 30 23:00:00.297723 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.297699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"]
Jul 30 23:00:00.299387 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:00:00.299358    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d572bf4_b94b_452c_b4a1_b9d0c21d6cf1.slice/crio-106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2 WatchSource:0}: Error finding container 106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2: Status 404 returned error can't find the container with id 106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2
Jul 30 23:00:00.301407 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.301392    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:00:00.590482 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:00.590449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf" event={"ID":"7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1","Type":"ContainerStarted","Data":"106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2"}
Jul 30 23:00:03.607895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:03.607854    2559 generic.go:356] "Generic (PLEG): container finished" podID="7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1" containerID="c94fe417df832cfc763ee5828a5dcfabc2b1abea95d9e3c69f3a2937b2b5a785" exitCode=0
Jul 30 23:00:03.608352 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:03.607913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf" event={"ID":"7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1","Type":"ContainerDied","Data":"c94fe417df832cfc763ee5828a5dcfabc2b1abea95d9e3c69f3a2937b2b5a785"}
Jul 30 23:00:04.769445 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:04.769419    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"
Jul 30 23:00:05.619903 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:05.619821    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf" event={"ID":"7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1","Type":"ContainerDied","Data":"106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2"}
Jul 30 23:00:05.619903 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:05.619851    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-ljvjf"
Jul 30 23:00:05.619903 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:00:05.619871    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="106b64f5955fc3ded7661bc33094c2cff1d3589a71c81acc96456baf2baa8be2"
Jul 30 23:02:09.999373 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:02:09.999336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:02:15.104157 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:02:15.104124    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:02:39.103735 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:02:39.103697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:02:49.703262 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:02:49.703181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:02:56.193001 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:02:56.192963    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:05.703126 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:05.703076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:10.898605 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:10.898566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:21.195073 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:21.195032    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:26.299560 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:26.299504    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:36.500401 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:36.500361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:41.298925 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:41.298888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:51.691170 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:51.691131    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:03:58.200876 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:03:58.200833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:06.097930 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:06.097893    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:12.494159 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:12.494047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:29.699365 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:29.699323    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:37.010957 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:37.010917    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:44.401205 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:44.401166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:04:55.401378 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:04:55.401335    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:10.701347 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:10.701305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:21.190283 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:21.190242    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:26.795919 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:26.795882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:33.097768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:33.097728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:44.101130 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:44.101022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:51.101143 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:51.101091    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:05:57.894138 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:05:57.894091    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:06.703524 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:06.703477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:16.499935 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:16.499889    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:23.990474 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:23.990432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:39.290810 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:39.290772    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:46.734471 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:46.734431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:06:57.895846 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:06:57.895807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:05.506979 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:05.506938    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:12.197564 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:12.197473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:17.104039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:17.103994    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:23.205181 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:23.205143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:33.092209 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:33.092161    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:40.400667 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:40.400625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:50.202440 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:50.202401    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:07:57.102388 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:07:57.102340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:07.199994 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:07.199956    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:22.696392 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:22.696352    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:29.611973 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:29.611940    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:40.398441 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:40.398362    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:47.516611 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:47.516559    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:08:55.203863 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:08:55.203829    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:09:00.907419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:00.907378    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:09:08.614914 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.614873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:08.615340 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.615323    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1" containerName="cleanup"
Jul 30 23:09:08.615340 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.615337    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1" containerName="cleanup"
Jul 30 23:09:08.615447 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.615422    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1" containerName="cleanup"
Jul 30 23:09:08.618687 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.618668    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.621913 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.621890    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 23:09:08.622044 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.621929    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5066b352-openshift-default-dockercfg-j4zxf\""
Jul 30 23:09:08.641137 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.641090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:08.701812 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.701812 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.701978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702226 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.702047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb465\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.702226 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.702072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803130 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803329 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803682 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803682 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb465\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803682 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.803682 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.804002 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.803980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.804135 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.804085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.804386 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.804364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.806237 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.806207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.806616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.806591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.812957 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.812923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.813200 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.813175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb465\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465\") pod \"e2e-ait-5066b352-openshift-default-7d4d585578-g2q82\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") " pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:08.929886 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:08.929786    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:09.081261 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:09.081234    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:09.082799 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:09:09.082768    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b99deb_321e_4f36_b39c_6adfb2578e52.slice/crio-e9d592e5cbe25f0181d1f9de515c3db8b63b50cfdddc28b3e1a1dde60a361918 WatchSource:0}: Error finding container e9d592e5cbe25f0181d1f9de515c3db8b63b50cfdddc28b3e1a1dde60a361918: Status 404 returned error can't find the container with id e9d592e5cbe25f0181d1f9de515c3db8b63b50cfdddc28b3e1a1dde60a361918
Jul 30 23:09:09.084680 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:09.084665    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:09:09.544771 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:09.544737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerStarted","Data":"e9d592e5cbe25f0181d1f9de515c3db8b63b50cfdddc28b3e1a1dde60a361918"}
Jul 30 23:09:11.936584 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:11.936539    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:11.936993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:11.936633    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:11.936993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:11.936675    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:12.565547 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:12.565508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerStarted","Data":"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"}
Jul 30 23:09:12.587894 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:12.587837    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podStartSLOduration=1.736365369 podStartE2EDuration="4.587819321s" totalImagesPullingTime="2.851453952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:09:12.585484776 +0000 UTC m=+1733.850730714" watchObservedRunningTime="2026-07-30 23:09:12.587819321 +0000 UTC m=+1733.853065330"
Jul 30 23:09:12.930264 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:12.930162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:12.935433 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:12.935401    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:13.571399 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:13.571369    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:13.572523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:13.572504    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:17.012262 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:17.012227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:09:26.653486 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.653401    2559 generic.go:356] "Generic (PLEG): container finished" podID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerID="d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11" exitCode=0
Jul 30 23:09:26.653896 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.653478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerDied","Data":"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"}
Jul 30 23:09:26.653896 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.653867    2559 scope.go:117] "RemoveContainer" containerID="d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"
Jul 30 23:09:26.654876 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.654843    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:26.654954 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.654919    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:26.654994 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:26.654955    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:27.660674 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:27.660636    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerStarted","Data":"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"}
Jul 30 23:09:27.936182 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:27.935443    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:27.936400 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:27.936370    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 23:09:27.936612 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:27.936585    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 23:09:28.571646 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:28.571617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:28.931233 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:28.931129    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 23:09:28.931816 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:28.931782    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 23:09:29.931056 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:29.931019    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 23:09:29.931385 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:29.931342    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 23:09:30.930742 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:30.930701    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 23:09:30.931039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:30.931010    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 23:09:31.931036 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:31.930999    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 23:09:31.931655 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:31.931621    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 23:09:32.934115 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:32.934069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:32.935174 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:32.935154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:39.585738 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.585694    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"]
Jul 30 23:09:39.594331 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.594298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:39.596950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.596925    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:09:39.597213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.597182    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:09:39.597386 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.597358    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"]
Jul 30 23:09:39.601762 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.601731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5066b352-qhw6h\" (UID: \"9f95c64b-1379-4259-b4f2-a14e4148decd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:39.702180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.702148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5066b352-qhw6h\" (UID: \"9f95c64b-1379-4259-b4f2-a14e4148decd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:39.702774 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.702754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5066b352-qhw6h\" (UID: \"9f95c64b-1379-4259-b4f2-a14e4148decd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:39.907301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:39.907208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:40.049017 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:40.048987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"]
Jul 30 23:09:40.050652 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:09:40.050614    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f95c64b_1379_4259_b4f2_a14e4148decd.slice/crio-e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe WatchSource:0}: Error finding container e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe: Status 404 returned error can't find the container with id e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe
Jul 30 23:09:40.732894 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:40.732857    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f95c64b-1379-4259-b4f2-a14e4148decd" containerID="4d0c78539eba24da97c7dfde1f2014765b9d287b0bfc5164ad66561ccb36da61" exitCode=0
Jul 30 23:09:40.733334 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:40.732947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h" event={"ID":"9f95c64b-1379-4259-b4f2-a14e4148decd","Type":"ContainerDied","Data":"4d0c78539eba24da97c7dfde1f2014765b9d287b0bfc5164ad66561ccb36da61"}
Jul 30 23:09:40.733334 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:40.733005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h" event={"ID":"9f95c64b-1379-4259-b4f2-a14e4148decd","Type":"ContainerStarted","Data":"e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe"}
Jul 30 23:09:41.880567 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:41.880530    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:41.915148 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:41.915079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca\") pod \"9f95c64b-1379-4259-b4f2-a14e4148decd\" (UID: \"9f95c64b-1379-4259-b4f2-a14e4148decd\") "
Jul 30 23:09:41.915506 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:41.915471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f95c64b-1379-4259-b4f2-a14e4148decd" (UID: "9f95c64b-1379-4259-b4f2-a14e4148decd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:09:42.016184 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:42.016040    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f95c64b-1379-4259-b4f2-a14e4148decd-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:42.746784 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:42.746748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h" event={"ID":"9f95c64b-1379-4259-b4f2-a14e4148decd","Type":"ContainerDied","Data":"e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe"}
Jul 30 23:09:42.746784 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:42.746772    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"
Jul 30 23:09:42.747079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:42.746799    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e16e4761501fbf0ba38199950b96ea65854522e1fed9ef329b3e7aad78c03afe"
Jul 30 23:09:45.766312 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:45.766270    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"]
Jul 30 23:09:45.768574 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:45.768549    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5066b352-qhw6h"]
Jul 30 23:09:45.902702 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:45.902664    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:45.902979 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:45.902951    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" containerID="cri-o://612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2" gracePeriod=30
Jul 30 23:09:46.936113 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.936063    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:09:46.936512 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.936482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f95c64b-1379-4259-b4f2-a14e4148decd" containerName="revoke-keys"
Jul 30 23:09:46.936512 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.936504    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f95c64b-1379-4259-b4f2-a14e4148decd" containerName="revoke-keys"
Jul 30 23:09:46.936591 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.936579    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f95c64b-1379-4259-b4f2-a14e4148decd" containerName="revoke-keys"
Jul 30 23:09:46.939810 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.939792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.942405 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.942378    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0aa67640-gw-openshift-default-dockercfg-qqrm2\""
Jul 30 23:09:46.952690 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.952660    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:09:46.959905 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.959868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.959928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.959965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.959983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.960002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvjdp\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.960042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.960058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960354 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.960140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:46.960354 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:46.960163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061058 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvjdp\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061267 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061267 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061267 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061267 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061267 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061546 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061546 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061546 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061546 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061766 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061766 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061841 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.061966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.061937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.063796 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.063764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.063960 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.063942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.070451 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.070417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.070684 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.070663    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvjdp\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp\") pod \"e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") " pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.241174 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.241135    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f95c64b-1379-4259-b4f2-a14e4148decd" path="/var/lib/kubelet/pods/9f95c64b-1379-4259-b4f2-a14e4148decd/volumes"
Jul 30 23:09:47.251188 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.251142    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:47.403113 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.403072    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:09:47.405491 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:09:47.405461    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64fdfe0_1379_4ac7_9a5f_198ebe6b94ef.slice/crio-ab18c52d7a13c8972dc0e04881795e4182df1de992008c6ebbd0808264ea9f86 WatchSource:0}: Error finding container ab18c52d7a13c8972dc0e04881795e4182df1de992008c6ebbd0808264ea9f86: Status 404 returned error can't find the container with id ab18c52d7a13c8972dc0e04881795e4182df1de992008c6ebbd0808264ea9f86
Jul 30 23:09:47.408441 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.408404    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:47.408570 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.408478    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:47.408570 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.408523    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:09:47.775992 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.775953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerStarted","Data":"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"}
Jul 30 23:09:47.776199 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.776020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerStarted","Data":"ab18c52d7a13c8972dc0e04881795e4182df1de992008c6ebbd0808264ea9f86"}
Jul 30 23:09:47.796844 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.796780    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podStartSLOduration=1.7967622140000001 podStartE2EDuration="1.796762214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:09:47.794454878 +0000 UTC m=+1769.059700816" watchObservedRunningTime="2026-07-30 23:09:47.796762214 +0000 UTC m=+1769.062008151"
Jul 30 23:09:47.937297 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.937256    2559 patch_prober.go:28] interesting pod/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:09:47.937761 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:47.937332    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:09:48.252296 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:48.252257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:48.257749 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:48.257723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:48.399196 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:48.399158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:09:48.783088 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:48.783053    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:48.784372 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:48.784343    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:09:51.158363 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.158324    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:51.202557 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202522    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202557 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202716    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.202808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202756    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb465\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202856    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs\") pod \"d6b99deb-321e-4f36-b39c-6adfb2578e52\" (UID: \"d6b99deb-321e-4f36-b39c-6adfb2578e52\") "
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202961    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.202974    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:09:51.203042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203020    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:09:51.203296 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203174    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:09:51.203357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203332    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.203357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203345    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6b99deb-321e-4f36-b39c-6adfb2578e52-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.203357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203354    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.203510 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203363    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.203510 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.203372    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.205383 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.205345    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:09:51.205536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.205441    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:09:51.205536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.205461    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465" (OuterVolumeSpecName: "kube-api-access-kb465") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "kube-api-access-kb465". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:09:51.205653 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.205570    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6b99deb-321e-4f36-b39c-6adfb2578e52" (UID: "d6b99deb-321e-4f36-b39c-6adfb2578e52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:09:51.304186 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.304147    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.304186 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.304177    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.304186 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.304190    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6b99deb-321e-4f36-b39c-6adfb2578e52-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.304428 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.304201    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb465\" (UniqueName: \"kubernetes.io/projected/d6b99deb-321e-4f36-b39c-6adfb2578e52-kube-api-access-kb465\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:09:51.806502 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.806462    2559 generic.go:356] "Generic (PLEG): container finished" podID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerID="612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2" exitCode=0
Jul 30 23:09:51.806709 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.806517    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"
Jul 30 23:09:51.806709 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.806525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerDied","Data":"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"}
Jul 30 23:09:51.806709 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.806579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82" event={"ID":"d6b99deb-321e-4f36-b39c-6adfb2578e52","Type":"ContainerDied","Data":"e9d592e5cbe25f0181d1f9de515c3db8b63b50cfdddc28b3e1a1dde60a361918"}
Jul 30 23:09:51.806709 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.806607    2559 scope.go:117] "RemoveContainer" containerID="612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"
Jul 30 23:09:51.816394 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.816373    2559 scope.go:117] "RemoveContainer" containerID="d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"
Jul 30 23:09:51.825561 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.825525    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:51.826189 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.826163    2559 scope.go:117] "RemoveContainer" containerID="612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"
Jul 30 23:09:51.826551 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:09:51.826530    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2\": container with ID starting with 612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2 not found: ID does not exist" containerID="612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"
Jul 30 23:09:51.826612 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.826561    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2"} err="failed to get container status \"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2\": rpc error: code = NotFound desc = could not find container \"612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2\": container with ID starting with 612906157d0dc1558c750416225b3f2462dd5177c3d055d3e56a18cdbbe831d2 not found: ID does not exist"
Jul 30 23:09:51.826612 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.826582    2559 scope.go:117] "RemoveContainer" containerID="d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"
Jul 30 23:09:51.827092 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:09:51.827018    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11\": container with ID starting with d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11 not found: ID does not exist" containerID="d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"
Jul 30 23:09:51.827092 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.827063    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11"} err="failed to get container status \"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11\": rpc error: code = NotFound desc = could not find container \"d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11\": container with ID starting with d9e45f40d63604d3ec06694f22bc943809e8fd902018ad2ca829e502238f7b11 not found: ID does not exist"
Jul 30 23:09:51.829923 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:51.829882    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5066b352-openshift-default-7d4d585578-g2q82"]
Jul 30 23:09:53.241204 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:53.241165    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" path="/var/lib/kubelet/pods/d6b99deb-321e-4f36-b39c-6adfb2578e52/volumes"
Jul 30 23:09:56.102848 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:09:56.102800    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:10:02.890814 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.890777    2559 generic.go:356] "Generic (PLEG): container finished" podID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerID="dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4" exitCode=0
Jul 30 23:10:02.891274 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.890866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerDied","Data":"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"}
Jul 30 23:10:02.891319 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.891308    2559 scope.go:117] "RemoveContainer" containerID="dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"
Jul 30 23:10:02.892365 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.892334    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:02.892424 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.892408    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:02.892460 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:02.892435    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:03.783479 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:03.783438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:03.898237 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:03.898198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerStarted","Data":"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"}
Jul 30 23:10:04.252194 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:04.252150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:04.253516 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:04.253480    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 30 23:10:04.253682 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:04.253537    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 30 23:10:05.252134 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:05.252078    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 30 23:10:05.252563 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:05.252143    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 30 23:10:06.251972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:06.251922    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 30 23:10:06.252199 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:06.251987    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 30 23:10:07.251924 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:07.251882    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 30 23:10:07.252133 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:07.251955    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 30 23:10:08.251703 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:08.251658    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 30 23:10:08.252233 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:08.251730    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 30 23:10:09.256653 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:09.256619    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:09.257115 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:09.256982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:09.257756 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:09.257738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:14.324929 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.324887    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"]
Jul 30 23:10:14.325419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.325333    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:14.325419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.325347    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:14.325419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.325414    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:14.325525 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.325424    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:14.327535 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.327506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:14.329952 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.329927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:10:14.330064 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.329927    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:10:14.335058 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.335029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"]
Jul 30 23:10:14.428729 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.428687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6\" (UID: \"7dea574a-c5b6-435b-9a63-3ce12aaed242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:14.530234 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.530194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6\" (UID: \"7dea574a-c5b6-435b-9a63-3ce12aaed242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:14.530828 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.530808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6\" (UID: \"7dea574a-c5b6-435b-9a63-3ce12aaed242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:14.640124 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.639994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:14.782286 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.782257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"]
Jul 30 23:10:14.784070 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:10:14.784030    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dea574a_c5b6_435b_9a63_3ce12aaed242.slice/crio-9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c WatchSource:0}: Error finding container 9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c: Status 404 returned error can't find the container with id 9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c
Jul 30 23:10:14.966574 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:14.966484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6" event={"ID":"7dea574a-c5b6-435b-9a63-3ce12aaed242","Type":"ContainerStarted","Data":"9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c"}
Jul 30 23:10:15.973560 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:15.973457    2559 generic.go:356] "Generic (PLEG): container finished" podID="7dea574a-c5b6-435b-9a63-3ce12aaed242" containerID="a2453f4d145c5399a50b302f8143338150bc59256d8ca856b4cc60bd0ae1be6d" exitCode=0
Jul 30 23:10:15.973560 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:15.973508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6" event={"ID":"7dea574a-c5b6-435b-9a63-3ce12aaed242","Type":"ContainerDied","Data":"a2453f4d145c5399a50b302f8143338150bc59256d8ca856b4cc60bd0ae1be6d"}
Jul 30 23:10:17.121357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.121325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:17.257328 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.257236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca\") pod \"7dea574a-c5b6-435b-9a63-3ce12aaed242\" (UID: \"7dea574a-c5b6-435b-9a63-3ce12aaed242\") "
Jul 30 23:10:17.257605 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.257579    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7dea574a-c5b6-435b-9a63-3ce12aaed242" (UID: "7dea574a-c5b6-435b-9a63-3ce12aaed242"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:10:17.358456 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.358412    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dea574a-c5b6-435b-9a63-3ce12aaed242-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:17.986794 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.986765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"
Jul 30 23:10:17.986794 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.986794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6" event={"ID":"7dea574a-c5b6-435b-9a63-3ce12aaed242","Type":"ContainerDied","Data":"9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c"}
Jul 30 23:10:17.986991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:17.986844    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9118d8448ed0da3725b16116591b8d85857d8b0b652a8a615121a3428656556c"
Jul 30 23:10:20.169740 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:20.169697    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"]
Jul 30 23:10:20.172451 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:20.172426    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0aa67640-rl4b6"]
Jul 30 23:10:20.304202 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:20.304157    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:10:20.304794 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:20.304726    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" containerID="cri-o://e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974" gracePeriod=30
Jul 30 23:10:21.140220 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140179    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:10:21.140664 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140646    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:21.140664 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140664    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b99deb-321e-4f36-b39c-6adfb2578e52" containerName="istio-proxy"
Jul 30 23:10:21.140769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140686    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dea574a-c5b6-435b-9a63-3ce12aaed242" containerName="revoke-keys"
Jul 30 23:10:21.140769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140692    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dea574a-c5b6-435b-9a63-3ce12aaed242" containerName="revoke-keys"
Jul 30 23:10:21.140769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.140760    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dea574a-c5b6-435b-9a63-3ce12aaed242" containerName="revoke-keys"
Jul 30 23:10:21.143325 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.143308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.146249 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.146222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b7dedfa4-openshift-default-dockercfg-5jzbf\""
Jul 30 23:10:21.155368 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.155337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:10:21.241982 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.241947    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dea574a-c5b6-435b-9a63-3ce12aaed242" path="/var/lib/kubelet/pods/7dea574a-c5b6-435b-9a63-3ce12aaed242/volumes"
Jul 30 23:10:21.293615 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.293842 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5s54\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.293842 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293667    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.293842 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.293842 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.293842 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.294039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.294039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.294039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.293942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395040 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.394940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395040 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.394996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395040 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5s54\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.395755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.395732    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.397550 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.397527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.397800 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.397782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.403638 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.403614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5s54\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.403758 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.403719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token\") pod \"e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") " pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.454836 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.454797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:21.598087 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.598060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:10:21.600026 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:10:21.599995    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d4fc4c_babb_4773_9fdf_201843affe2c.slice/crio-76a52d396ba885146692937f23856124569b2f688ba5430fae1932b80b644213 WatchSource:0}: Error finding container 76a52d396ba885146692937f23856124569b2f688ba5430fae1932b80b644213: Status 404 returned error can't find the container with id 76a52d396ba885146692937f23856124569b2f688ba5430fae1932b80b644213
Jul 30 23:10:21.602338 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.602299    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:21.602454 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.602387    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:21.602454 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:21.602433    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:22.012085 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.012048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerStarted","Data":"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"}
Jul 30 23:10:22.012292 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.012125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerStarted","Data":"76a52d396ba885146692937f23856124569b2f688ba5430fae1932b80b644213"}
Jul 30 23:10:22.035566 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.035507    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podStartSLOduration=1.035487456 podStartE2EDuration="1.035487456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:10:22.033358894 +0000 UTC m=+1803.298604854" watchObservedRunningTime="2026-07-30 23:10:22.035487456 +0000 UTC m=+1803.300733393"
Jul 30 23:10:22.455375 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.455280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:22.460371 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.460342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:22.804472 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:22.804433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:10:23.018784 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:23.018748    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:23.019795 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:23.019769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:24.260212 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:24.260167    2559 patch_prober.go:28] interesting pod/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 30 23:10:24.260636 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:24.260253    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:10:25.575541 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.575515    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:25.735243 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735243 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735266    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735310    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvjdp\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735345    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735374    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735480 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735437    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo\") pod \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\" (UID: \"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef\") "
Jul 30 23:10:25.735768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735558    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:10:25.735768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735583    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:10:25.735768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735716    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:10:25.735941 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:10:25.735941 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735897    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.735941 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735917    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.735941 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735932    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.736168 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735946    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.736168 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.735898    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:10:25.737839 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.737812    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp" (OuterVolumeSpecName: "kube-api-access-rvjdp") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "kube-api-access-rvjdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:10:25.737839 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.737830    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:10:25.737994 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.737837    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:10:25.738053 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.738037    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" (UID: "e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:10:25.836496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.836454    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.836496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.836488    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.836496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.836510    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.836775 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.836522    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvjdp\" (UniqueName: \"kubernetes.io/projected/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-kube-api-access-rvjdp\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:25.836775 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:25.836534    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:26.038802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.038712    2559 generic.go:356] "Generic (PLEG): container finished" podID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerID="e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974" exitCode=0
Jul 30 23:10:26.038802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.038766    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"
Jul 30 23:10:26.038802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.038780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerDied","Data":"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"}
Jul 30 23:10:26.039046 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.038833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw" event={"ID":"e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef","Type":"ContainerDied","Data":"ab18c52d7a13c8972dc0e04881795e4182df1de992008c6ebbd0808264ea9f86"}
Jul 30 23:10:26.039046 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.038854    2559 scope.go:117] "RemoveContainer" containerID="e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"
Jul 30 23:10:26.049956 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.049937    2559 scope.go:117] "RemoveContainer" containerID="dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"
Jul 30 23:10:26.059459 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.059436    2559 scope.go:117] "RemoveContainer" containerID="e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"
Jul 30 23:10:26.059767 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:10:26.059746    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974\": container with ID starting with e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974 not found: ID does not exist" containerID="e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"
Jul 30 23:10:26.059833 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.059781    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974"} err="failed to get container status \"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974\": rpc error: code = NotFound desc = could not find container \"e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974\": container with ID starting with e092ae56103d721c458a40b3a70e4cde076b0b3a75807100b976c6b1e631c974 not found: ID does not exist"
Jul 30 23:10:26.059833 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.059807    2559 scope.go:117] "RemoveContainer" containerID="dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"
Jul 30 23:10:26.060073 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:10:26.060056    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4\": container with ID starting with dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4 not found: ID does not exist" containerID="dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"
Jul 30 23:10:26.060142 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.060080    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4"} err="failed to get container status \"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4\": rpc error: code = NotFound desc = could not find container \"dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4\": container with ID starting with dfcfcfb02dcca9f6a8a42d132d588bef79406391aaba44678aa1866c86aa71a4 not found: ID does not exist"
Jul 30 23:10:26.065069 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.065044    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:10:26.067266 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:26.067245    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0aa67640-gw-openshift-default-55d48d5484-75mtw"]
Jul 30 23:10:27.241874 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:27.241827    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" path="/var/lib/kubelet/pods/e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef/volumes"
Jul 30 23:10:31.395427 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:31.395391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:10:38.020985 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.020948    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:38.021436 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.021005    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:38.120957 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.120918    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerID="f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b" exitCode=0
Jul 30 23:10:38.121168 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.120962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerDied","Data":"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"}
Jul 30 23:10:38.121431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.121413    2559 scope.go:117] "RemoveContainer" containerID="f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"
Jul 30 23:10:38.122459 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.122429    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:38.122515 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.122499    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:38.122567 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:38.122540    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:39.133803 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:39.133755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerStarted","Data":"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"}
Jul 30 23:10:39.455958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:39.455852    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:39.456304 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:39.456277    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:39.456451 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:39.456328    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:40.456054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:40.456011    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:40.456507 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:40.456069    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:41.455467 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:41.455425    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:41.455654 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:41.455495    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:42.455897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:42.455860    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:42.456357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:42.455918    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:43.455771 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:43.455726    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 30 23:10:43.455964 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:43.455790    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 30 23:10:44.459617 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:44.459583    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:44.460011 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:44.459973    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:44.460638 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:44.460621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:10:49.293989 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.293952    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"]
Jul 30 23:10:49.294486 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294390    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.294486 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294405    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.294486 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294424    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.294486 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294433    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.294614 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294512    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.294614 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.294522    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64fdfe0-1379-4ac7-9a5f-198ebe6b94ef" containerName="istio-proxy"
Jul 30 23:10:49.296813 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.296797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:49.299232 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.299207    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:10:49.299232 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.299232    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:10:49.307133 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.307083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"]
Jul 30 23:10:49.362010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.361967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m\" (UID: \"241e668b-4d35-4d3d-9a39-1702da3f9037\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:49.463428 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.463373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m\" (UID: \"241e668b-4d35-4d3d-9a39-1702da3f9037\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:49.464011 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.463986    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m\" (UID: \"241e668b-4d35-4d3d-9a39-1702da3f9037\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:49.608443 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.608360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:49.748340 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:49.748277    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"]
Jul 30 23:10:49.751063 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:10:49.751036    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241e668b_4d35_4d3d_9a39_1702da3f9037.slice/crio-0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5 WatchSource:0}: Error finding container 0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5: Status 404 returned error can't find the container with id 0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5
Jul 30 23:10:50.198681 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:50.198569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m" event={"ID":"241e668b-4d35-4d3d-9a39-1702da3f9037","Type":"ContainerStarted","Data":"41bab5dc6214de0e98640e6d837c7642dffc9a812c5281e36d98deecb6b80564"}
Jul 30 23:10:50.198681 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:50.198673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m" event={"ID":"241e668b-4d35-4d3d-9a39-1702da3f9037","Type":"ContainerStarted","Data":"0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5"}
Jul 30 23:10:50.215376 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:50.215327    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m" podStartSLOduration=1.215309826 podStartE2EDuration="1.215309826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:10:50.213828883 +0000 UTC m=+1831.479074812" watchObservedRunningTime="2026-07-30 23:10:50.215309826 +0000 UTC m=+1831.480555762"
Jul 30 23:10:51.205224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:51.205183    2559 generic.go:356] "Generic (PLEG): container finished" podID="241e668b-4d35-4d3d-9a39-1702da3f9037" containerID="41bab5dc6214de0e98640e6d837c7642dffc9a812c5281e36d98deecb6b80564" exitCode=0
Jul 30 23:10:51.205678 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:51.205275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m" event={"ID":"241e668b-4d35-4d3d-9a39-1702da3f9037","Type":"ContainerDied","Data":"41bab5dc6214de0e98640e6d837c7642dffc9a812c5281e36d98deecb6b80564"}
Jul 30 23:10:52.345529 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:52.345504    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:52.392053 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:52.392018    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca\") pod \"241e668b-4d35-4d3d-9a39-1702da3f9037\" (UID: \"241e668b-4d35-4d3d-9a39-1702da3f9037\") "
Jul 30 23:10:52.392424 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:52.392398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "241e668b-4d35-4d3d-9a39-1702da3f9037" (UID: "241e668b-4d35-4d3d-9a39-1702da3f9037"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:10:52.493671 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:52.493637    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241e668b-4d35-4d3d-9a39-1702da3f9037-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:10:53.217675 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:53.217641    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"
Jul 30 23:10:53.217874 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:53.217684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m" event={"ID":"241e668b-4d35-4d3d-9a39-1702da3f9037","Type":"ContainerDied","Data":"0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5"}
Jul 30 23:10:53.217874 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:53.217752    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0454f17ffd21fbdddd3a5446e708c4050e68c2ca7db61ddca624c9872d0796f5"
Jul 30 23:10:55.333994 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:55.333960    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"]
Jul 30 23:10:55.336379 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:55.336353    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b7dedfa4-rz45m"]
Jul 30 23:10:56.508766 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:56.508731    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:10:56.509263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:56.508944    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" containerID="cri-o://e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee" gracePeriod=30
Jul 30 23:10:57.240457 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.240426    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241e668b-4d35-4d3d-9a39-1702da3f9037" path="/var/lib/kubelet/pods/241e668b-4d35-4d3d-9a39-1702da3f9037/volumes"
Jul 30 23:10:57.279414 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.279381    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:10:57.279802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.279788    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241e668b-4d35-4d3d-9a39-1702da3f9037" containerName="revoke-keys"
Jul 30 23:10:57.279843 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.279804    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="241e668b-4d35-4d3d-9a39-1702da3f9037" containerName="revoke-keys"
Jul 30 23:10:57.279892 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.279882    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="241e668b-4d35-4d3d-9a39-1702da3f9037" containerName="revoke-keys"
Jul 30 23:10:57.282160 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.282144    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.284938 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.284906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-94a93f51-openshift-default-dockercfg-fmhbd\""
Jul 30 23:10:57.294172 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.294144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:10:57.442528 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxt2r\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442716 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.442937 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.442763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543316 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543316 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543316 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxt2r\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.543845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.543664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.544229 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.544031    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.544229 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.544203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.545829 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.545806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.546244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.546223    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.552216 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.552186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxt2r\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.552216 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.552208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token\") pod \"e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") " pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.594488 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.594448    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:57.735432 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.735406    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:10:57.737410 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:10:57.737378    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f712fda_a36c_4892_a8a1_c2e341f8f46c.slice/crio-a1dc917c90d30fe0e80a1076d8ed5dc55af0563f24ab325ca7ba6af2bdd386c1 WatchSource:0}: Error finding container a1dc917c90d30fe0e80a1076d8ed5dc55af0563f24ab325ca7ba6af2bdd386c1: Status 404 returned error can't find the container with id a1dc917c90d30fe0e80a1076d8ed5dc55af0563f24ab325ca7ba6af2bdd386c1
Jul 30 23:10:57.739828 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.739785    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:57.739909 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.739883    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:57.739945 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:57.739925    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:10:58.004843 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.004807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:10:58.248688 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.248643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerStarted","Data":"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"}
Jul 30 23:10:58.248878 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.248701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerStarted","Data":"a1dc917c90d30fe0e80a1076d8ed5dc55af0563f24ab325ca7ba6af2bdd386c1"}
Jul 30 23:10:58.267220 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.267059    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podStartSLOduration=1.267035862 podStartE2EDuration="1.267035862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:10:58.266881582 +0000 UTC m=+1839.532127521" watchObservedRunningTime="2026-07-30 23:10:58.267035862 +0000 UTC m=+1839.532281799"
Jul 30 23:10:58.595399 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.595305    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:58.599990 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:58.599964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:59.255318 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:59.255285    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:59.256381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:59.256358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:10:59.462836 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:59.462793    2559 patch_prober.go:28] interesting pod/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:10:59.462987 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:10:59.462851    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:11:01.764643 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.764597    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:11:01.886431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886343    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886382    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5s54\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886400    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886425    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886448    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886600    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886641    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886667    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs\") pod \"c7d4fc4c-babb-4773-9fdf-201843affe2c\" (UID: \"c7d4fc4c-babb-4773-9fdf-201843affe2c\") "
Jul 30 23:11:01.886750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886745    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:01.887044 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886914    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:01.887044 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:01.887044 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.886994    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:11:01.887218 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.887084    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:01.887218 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.887088    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.887333 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.887221    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.887333 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.887309    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.888787 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.888749    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54" (OuterVolumeSpecName: "kube-api-access-s5s54") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "kube-api-access-s5s54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:11:01.888904 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.888882    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:11:01.888972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.888947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:01.889067 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.889050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7d4fc4c-babb-4773-9fdf-201843affe2c" (UID: "c7d4fc4c-babb-4773-9fdf-201843affe2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:11:01.987800 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987760    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.987800 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987792    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.987800 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987801    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5s54\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-kube-api-access-s5s54\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.987800 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987810    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.988154 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987818    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d4fc4c-babb-4773-9fdf-201843affe2c-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:01.988154 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:01.987825    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d4fc4c-babb-4773-9fdf-201843affe2c-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:02.272327 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.272292    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerID="e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee" exitCode=0
Jul 30 23:11:02.272531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.272349    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"
Jul 30 23:11:02.272531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.272370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerDied","Data":"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"}
Jul 30 23:11:02.272531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.272426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg" event={"ID":"c7d4fc4c-babb-4773-9fdf-201843affe2c","Type":"ContainerDied","Data":"76a52d396ba885146692937f23856124569b2f688ba5430fae1932b80b644213"}
Jul 30 23:11:02.272531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.272449    2559 scope.go:117] "RemoveContainer" containerID="e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"
Jul 30 23:11:02.282885 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.282868    2559 scope.go:117] "RemoveContainer" containerID="f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"
Jul 30 23:11:02.292681 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.292653    2559 scope.go:117] "RemoveContainer" containerID="e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"
Jul 30 23:11:02.292972 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:11:02.292951    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee\": container with ID starting with e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee not found: ID does not exist" containerID="e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"
Jul 30 23:11:02.293038 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.292983    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee"} err="failed to get container status \"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee\": rpc error: code = NotFound desc = could not find container \"e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee\": container with ID starting with e3776856e38865bd09dd15f26bcf8b432ae2859329ee753fa2bbef86382fc3ee not found: ID does not exist"
Jul 30 23:11:02.293038 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.293002    2559 scope.go:117] "RemoveContainer" containerID="f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"
Jul 30 23:11:02.293300 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:11:02.293285    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b\": container with ID starting with f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b not found: ID does not exist" containerID="f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"
Jul 30 23:11:02.293355 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.293304    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b"} err="failed to get container status \"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b\": rpc error: code = NotFound desc = could not find container \"f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b\": container with ID starting with f0a77b72f8034b313dafd489529ed6ae0ffe276edcec17703e784003f47fc21b not found: ID does not exist"
Jul 30 23:11:02.294695 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.294676    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:11:02.300570 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:02.300545    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b7dedfa4-openshift-default-6b7f79988b-m5kxg"]
Jul 30 23:11:03.240848 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:03.240817    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" path="/var/lib/kubelet/pods/c7d4fc4c-babb-4773-9fdf-201843affe2c/volumes"
Jul 30 23:11:04.393195 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:04.393158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:11:14.256925 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.256834    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:14.256925 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.256897    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:14.348594 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.348555    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerID="032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38" exitCode=0
Jul 30 23:11:14.348799 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.348630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerDied","Data":"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"}
Jul 30 23:11:14.349079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.349065    2559 scope.go:117] "RemoveContainer" containerID="032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"
Jul 30 23:11:14.350138 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.350079    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:11:14.350248 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.350176    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:11:14.350248 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:14.350211    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:11:15.359065 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:15.359029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerStarted","Data":"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"}
Jul 30 23:11:15.595665 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:15.595627    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:15.595941 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:15.595915    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:15.596031 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:15.595973    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:16.595155 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:16.595092    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:16.595536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:16.595186    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:17.595471 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:17.595431    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:17.595857 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:17.595497    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:18.595419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:18.595387    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:18.595549 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:18.595461    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:19.594858 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:19.594822    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 23:11:19.595021 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:19.594877    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 23:11:20.599049 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:20.599019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:20.599536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:20.599304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:20.600007 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:20.599991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:24.528048 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528009    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"]
Jul 30 23:11:24.528435 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528424    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.528485 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528437    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.528485 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528452    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.528485 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528457    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.528577 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528530    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.528577 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.528537    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d4fc4c-babb-4773-9fdf-201843affe2c" containerName="istio-proxy"
Jul 30 23:11:24.530583 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.530567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:24.533139 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.533114    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:11:24.533266 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.533151    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:11:24.537972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.537922    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"]
Jul 30 23:11:24.598614 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.598578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn\" (UID: \"e21aed96-26b1-452d-82f8-bd6a9b5b4b33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:24.699586 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.699553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn\" (UID: \"e21aed96-26b1-452d-82f8-bd6a9b5b4b33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:24.700191 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.700172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn\" (UID: \"e21aed96-26b1-452d-82f8-bd6a9b5b4b33\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:24.842238 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.842148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:24.973458 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:24.973432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"]
Jul 30 23:11:24.975265 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:11:24.975238    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21aed96_26b1_452d_82f8_bd6a9b5b4b33.slice/crio-0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a WatchSource:0}: Error finding container 0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a: Status 404 returned error can't find the container with id 0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a
Jul 30 23:11:25.418235 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:25.418125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn" event={"ID":"e21aed96-26b1-452d-82f8-bd6a9b5b4b33","Type":"ContainerStarted","Data":"9455926296e6682e08f853a1e4b6acf962c994b554ea67aca1a37d3090a0db28"}
Jul 30 23:11:25.418235 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:25.418201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn" event={"ID":"e21aed96-26b1-452d-82f8-bd6a9b5b4b33","Type":"ContainerStarted","Data":"0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a"}
Jul 30 23:11:25.434990 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:25.434941    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn" podStartSLOduration=1.434926639 podStartE2EDuration="1.434926639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:11:25.432892886 +0000 UTC m=+1866.698138825" watchObservedRunningTime="2026-07-30 23:11:25.434926639 +0000 UTC m=+1866.700172575"
Jul 30 23:11:26.426000 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:26.425969    2559 generic.go:356] "Generic (PLEG): container finished" podID="e21aed96-26b1-452d-82f8-bd6a9b5b4b33" containerID="9455926296e6682e08f853a1e4b6acf962c994b554ea67aca1a37d3090a0db28" exitCode=0
Jul 30 23:11:26.426412 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:26.426051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn" event={"ID":"e21aed96-26b1-452d-82f8-bd6a9b5b4b33","Type":"ContainerDied","Data":"9455926296e6682e08f853a1e4b6acf962c994b554ea67aca1a37d3090a0db28"}
Jul 30 23:11:27.569427 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:27.569405    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:27.625039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:27.625012    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca\") pod \"e21aed96-26b1-452d-82f8-bd6a9b5b4b33\" (UID: \"e21aed96-26b1-452d-82f8-bd6a9b5b4b33\") "
Jul 30 23:11:27.625380 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:27.625355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e21aed96-26b1-452d-82f8-bd6a9b5b4b33" (UID: "e21aed96-26b1-452d-82f8-bd6a9b5b4b33"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:11:27.725751 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:27.725665    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21aed96-26b1-452d-82f8-bd6a9b5b4b33-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:28.439005 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:28.438977    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"
Jul 30 23:11:28.439200 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:28.439018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn" event={"ID":"e21aed96-26b1-452d-82f8-bd6a9b5b4b33","Type":"ContainerDied","Data":"0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a"}
Jul 30 23:11:28.439200 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:28.439062    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fee8a6d42c3709d15a91fb5ed2c71018133d9005e105df7ffba003f77fbd10a"
Jul 30 23:11:31.432696 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:31.432658    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"]
Jul 30 23:11:31.436579 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:31.436552    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-94a93f51-zd2hn"]
Jul 30 23:11:31.571953 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:31.571908    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:11:31.572224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:31.572196    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" containerID="cri-o://10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973" gracePeriod=30
Jul 30 23:11:33.240733 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:33.240701    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21aed96-26b1-452d-82f8-bd6a9b5b4b33" path="/var/lib/kubelet/pods/e21aed96-26b1-452d-82f8-bd6a9b5b4b33/volumes"
Jul 30 23:11:34.300987 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:34.300953    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:11:35.602205 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:35.602162    2559 patch_prober.go:28] interesting pod/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:11:35.602639 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:35.602244    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:11:36.828483 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.828454    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:36.907687 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907613    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxt2r\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907687 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907687 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907681    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907700    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907766    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907790    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.907932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907848    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs\") pod \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\" (UID: \"6f712fda-a36c-4892-a8a1-c2e341f8f46c\") "
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907935    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.907968    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908147    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908171    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908240    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908237    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908259    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:36.908285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.908273    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:36.910013 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.909987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r" (OuterVolumeSpecName: "kube-api-access-lxt2r") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "kube-api-access-lxt2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:11:36.910180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.910036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:11:36.910180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.910083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:11:36.910493 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:36.910476    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f712fda-a36c-4892-a8a1-c2e341f8f46c" (UID: "6f712fda-a36c-4892-a8a1-c2e341f8f46c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:11:37.009745 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009713    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxt2r\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-kube-api-access-lxt2r\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.009745 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009740    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.009745 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009750    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.009966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009757    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.009966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009765    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.009966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.009772    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f712fda-a36c-4892-a8a1-c2e341f8f46c-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:11:37.488372 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.488338    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerID="10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973" exitCode=0
Jul 30 23:11:37.488553 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.488392    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"
Jul 30 23:11:37.488553 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.488414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerDied","Data":"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"}
Jul 30 23:11:37.488553 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.488467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb" event={"ID":"6f712fda-a36c-4892-a8a1-c2e341f8f46c","Type":"ContainerDied","Data":"a1dc917c90d30fe0e80a1076d8ed5dc55af0563f24ab325ca7ba6af2bdd386c1"}
Jul 30 23:11:37.488553 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.488487    2559 scope.go:117] "RemoveContainer" containerID="10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"
Jul 30 23:11:37.497762 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.497739    2559 scope.go:117] "RemoveContainer" containerID="032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"
Jul 30 23:11:37.506559 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.506538    2559 scope.go:117] "RemoveContainer" containerID="10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"
Jul 30 23:11:37.506824 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:11:37.506799    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973\": container with ID starting with 10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973 not found: ID does not exist" containerID="10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"
Jul 30 23:11:37.506879 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.506839    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973"} err="failed to get container status \"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973\": rpc error: code = NotFound desc = could not find container \"10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973\": container with ID starting with 10c447f6fcb795783101c4e00b138ffab2e21b9da0b816afac102ef011480973 not found: ID does not exist"
Jul 30 23:11:37.506879 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.506862    2559 scope.go:117] "RemoveContainer" containerID="032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"
Jul 30 23:11:37.507149 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:11:37.507131    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38\": container with ID starting with 032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38 not found: ID does not exist" containerID="032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"
Jul 30 23:11:37.507213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.507156    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38"} err="failed to get container status \"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38\": rpc error: code = NotFound desc = could not find container \"032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38\": container with ID starting with 032f82c6a6817ea63cdd8d00bc4726b581227438006e85e5036019d648436f38 not found: ID does not exist"
Jul 30 23:11:37.508277 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.508259    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:11:37.515387 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:37.515369    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-94a93f51-openshift-default-867d7f9c6d-dfwbb"]
Jul 30 23:11:39.241053 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:39.241024    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" path="/var/lib/kubelet/pods/6f712fda-a36c-4892-a8a1-c2e341f8f46c/volumes"
Jul 30 23:11:47.120394 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:11:47.120357    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:13:17.907726 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:17.907650    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:13:24.994890 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:24.994856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:13:30.459319 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459288    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:13:30.459824 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459807    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.459897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459830    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.459897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459843    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.459897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459849    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.459897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459871    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21aed96-26b1-452d-82f8-bd6a9b5b4b33" containerName="revoke-keys"
Jul 30 23:13:30.459897 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459879    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21aed96-26b1-452d-82f8-bd6a9b5b4b33" containerName="revoke-keys"
Jul 30 23:13:30.460068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459936    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.460068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459945    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f712fda-a36c-4892-a8a1-c2e341f8f46c" containerName="istio-proxy"
Jul 30 23:13:30.460068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.459953    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21aed96-26b1-452d-82f8-bd6a9b5b4b33" containerName="revoke-keys"
Jul 30 23:13:30.461969 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.461953    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.464613 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.464584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-85a1df81-openshift-default-dockercfg-7h547\""
Jul 30 23:13:30.464753 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.464672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 23:13:30.486077 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.486049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:13:30.646715 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646660    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.646715 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72mhg\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.646955 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.646955 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.646955 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.647077 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.646987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.647077 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.647039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.647077 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.647070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.647227 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.647124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748450 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748450 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72mhg\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.748714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.749063 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.748880    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.749063 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.749014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.749063 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.749034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.749254 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.749196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.749585 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.749563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.751109 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.751073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.751663 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.751641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.763790 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.763761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72mhg\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.763921 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.763902    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token\") pod \"e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") " pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.772930 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.772910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:30.912218 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.912191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:13:30.914071 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:13:30.914051    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4403f3b7_2a5e_4ae6_83f5_9866fdb56b04.slice/crio-f6f85e2ff0345f00746b44d0bcc8527d671cc5805712a579180990e3a2a28c27 WatchSource:0}: Error finding container f6f85e2ff0345f00746b44d0bcc8527d671cc5805712a579180990e3a2a28c27: Status 404 returned error can't find the container with id f6f85e2ff0345f00746b44d0bcc8527d671cc5805712a579180990e3a2a28c27
Jul 30 23:13:30.916079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.916044    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:30.916190 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.916136    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:30.916190 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:30.916167    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:31.134190 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:31.134060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerStarted","Data":"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"}
Jul 30 23:13:31.134190 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:31.134143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerStarted","Data":"f6f85e2ff0345f00746b44d0bcc8527d671cc5805712a579180990e3a2a28c27"}
Jul 30 23:13:31.153937 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:31.153887    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podStartSLOduration=1.153871031 podStartE2EDuration="1.153871031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:13:31.151548921 +0000 UTC m=+1992.416794872" watchObservedRunningTime="2026-07-30 23:13:31.153871031 +0000 UTC m=+1992.419117085"
Jul 30 23:13:31.773438 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:31.773404    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:31.778144 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:31.778122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:32.139799 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:32.139706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:32.140721 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:32.140701    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:37.003088 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:37.003052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:13:47.141021 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.140986    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:47.141463 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.141054    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:47.228757 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.228720    2559 generic.go:356] "Generic (PLEG): container finished" podID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerID="8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d" exitCode=0
Jul 30 23:13:47.228757 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.228745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerDied","Data":"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"}
Jul 30 23:13:47.229221 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.229200    2559 scope.go:117] "RemoveContainer" containerID="8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"
Jul 30 23:13:47.230275 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.230247    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:47.230371 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.230319    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:47.230371 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:47.230358    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:13:48.241750 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:48.241713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerStarted","Data":"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"}
Jul 30 23:13:48.773752 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:48.773713    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:48.773931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:48.773913    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:48.773975 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:48.773957    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:49.773965 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:49.773923    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:49.774454 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:49.773992    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:50.773783 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:50.773746    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:50.773961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:50.773818    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:51.774246 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:51.774208    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:51.774631 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:51.774263    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:52.774278 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:52.774244    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 23:13:52.774655 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:52.774316    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 23:13:53.777043 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:53.777005    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:53.777530 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:53.777405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:13:53.778039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:13:53.778019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:14:05.571670 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.571631    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"]
Jul 30 23:14:05.574219 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.574197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:05.576959 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.576940    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:14:05.577081 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.576977    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:14:05.582458 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.582430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"]
Jul 30 23:14:05.658851 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.658819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t\" (UID: \"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:05.759845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.759815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t\" (UID: \"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:05.760444 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.760426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t\" (UID: \"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:05.886041 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:05.885975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:06.023653 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:06.023630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"]
Jul 30 23:14:06.025483 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:14:06.025455    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0381d9_a1ac_4fd6_8cf7_6a38e22df0dc.slice/crio-958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954 WatchSource:0}: Error finding container 958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954: Status 404 returned error can't find the container with id 958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954
Jul 30 23:14:06.343175 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:06.343144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t" event={"ID":"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc","Type":"ContainerStarted","Data":"6af8f53475bf20e693257a14602cd382715f9302d19e3bdf5d16fbbdc4d1827b"}
Jul 30 23:14:06.343300 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:06.343197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t" event={"ID":"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc","Type":"ContainerStarted","Data":"958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954"}
Jul 30 23:14:06.360914 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:06.360863    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t" podStartSLOduration=1.360848865 podStartE2EDuration="1.360848865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:14:06.358685845 +0000 UTC m=+2027.623931786" watchObservedRunningTime="2026-07-30 23:14:06.360848865 +0000 UTC m=+2027.626094801"
Jul 30 23:14:07.349718 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:07.349679    2559 generic.go:356] "Generic (PLEG): container finished" podID="7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" containerID="6af8f53475bf20e693257a14602cd382715f9302d19e3bdf5d16fbbdc4d1827b" exitCode=0
Jul 30 23:14:07.350191 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:07.349769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t" event={"ID":"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc","Type":"ContainerDied","Data":"6af8f53475bf20e693257a14602cd382715f9302d19e3bdf5d16fbbdc4d1827b"}
Jul 30 23:14:08.509924 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:08.509898    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:08.584582 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:08.584546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca\") pod \"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc\" (UID: \"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc\") "
Jul 30 23:14:08.584891 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:08.584868    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" (UID: "7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:14:08.685960 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:08.685874    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:09.363489 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:09.363456    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"
Jul 30 23:14:09.363489 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:09.363484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t" event={"ID":"7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc","Type":"ContainerDied","Data":"958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954"}
Jul 30 23:14:09.363729 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:09.363525    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="958a01a6f5534b311e82024063f1908fe5f2ff354a7336ce83118caf1909a954"
Jul 30 23:14:16.329933 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:16.329881    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"]
Jul 30 23:14:16.332768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:16.332746    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-85a1df81-dzz8t"]
Jul 30 23:14:17.240445 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:17.240407    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" path="/var/lib/kubelet/pods/7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc/volumes"
Jul 30 23:14:18.401012 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:18.400977    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:14:22.565505 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:22.565467    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:14:22.565895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:22.565699    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" containerID="cri-o://187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228" gracePeriod=30
Jul 30 23:14:23.779472 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:23.779431    2559 patch_prober.go:28] interesting pod/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 30 23:14:23.779809 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:23.779487    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:14:27.807028 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.807004    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:14:27.865616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865539    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865610    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865700    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.865864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865768    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.866147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865908    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72mhg\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg\") pod \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\" (UID: \"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04\") "
Jul 30 23:14:27.866147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:14:27.866147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:14:27.866147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.865971    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data" (OuterVolumeSpecName: "istio-data") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:14:27.866377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.866227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:14:27.866377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.866273    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:14:27.866377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.866293    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.866377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.866316    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.866377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.866330    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.867824 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.867799    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:14:27.867998 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.867971    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:14:27.868120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.867992    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token" (OuterVolumeSpecName: "istio-token") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:14:27.868120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.868039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg" (OuterVolumeSpecName: "kube-api-access-72mhg") pod "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" (UID: "4403f3b7-2a5e-4ae6-83f5-9866fdb56b04"). InnerVolumeSpecName "kube-api-access-72mhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:14:27.967493 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967471    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.967493 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967490    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72mhg\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-kube-api-access-72mhg\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.967642 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967500    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.967642 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967509    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.967642 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967516    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:27.967642 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:27.967525    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:14:28.476496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.476456    2559 generic.go:356] "Generic (PLEG): container finished" podID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerID="187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228" exitCode=0
Jul 30 23:14:28.476689 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.476520    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"
Jul 30 23:14:28.476689 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.476540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerDied","Data":"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"}
Jul 30 23:14:28.476689 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.476615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx" event={"ID":"4403f3b7-2a5e-4ae6-83f5-9866fdb56b04","Type":"ContainerDied","Data":"f6f85e2ff0345f00746b44d0bcc8527d671cc5805712a579180990e3a2a28c27"}
Jul 30 23:14:28.476689 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.476638    2559 scope.go:117] "RemoveContainer" containerID="187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"
Jul 30 23:14:28.486565 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.486549    2559 scope.go:117] "RemoveContainer" containerID="8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"
Jul 30 23:14:28.495321 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.495235    2559 scope.go:117] "RemoveContainer" containerID="187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"
Jul 30 23:14:28.496586 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:14:28.496557    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228\": container with ID starting with 187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228 not found: ID does not exist" containerID="187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"
Jul 30 23:14:28.496680 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.496595    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228"} err="failed to get container status \"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228\": rpc error: code = NotFound desc = could not find container \"187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228\": container with ID starting with 187097240af470a0e0d944f7d0c4708a4554496c8ed7c54a080303f6be143228 not found: ID does not exist"
Jul 30 23:14:28.496680 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.496613    2559 scope.go:117] "RemoveContainer" containerID="8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"
Jul 30 23:14:28.496913 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:14:28.496879    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d\": container with ID starting with 8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d not found: ID does not exist" containerID="8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"
Jul 30 23:14:28.496961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.496920    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d"} err="failed to get container status \"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d\": rpc error: code = NotFound desc = could not find container \"8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d\": container with ID starting with 8b4e82ee1625828d498a011fe8b85b33bb2d4a264e98fdaa1206632d90753c2d not found: ID does not exist"
Jul 30 23:14:28.499006 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.498920    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:14:28.501362 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:28.501344    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-85a1df81-openshift-default-864cb568d4-k5nqx"]
Jul 30 23:14:29.241020 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:29.240986    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" path="/var/lib/kubelet/pods/4403f3b7-2a5e-4ae6-83f5-9866fdb56b04/volumes"
Jul 30 23:14:54.097816 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:14:54.097776    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:15:00.141706 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.141668    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"]
Jul 30 23:15:00.142076 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142057    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:15:00.142076 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142068    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:15:00.142208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142081    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" containerName="revoke-keys"
Jul 30 23:15:00.142208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142087    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" containerName="revoke-keys"
Jul 30 23:15:00.142208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142162    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0381d9-a1ac-4fd6-8cf7-6a38e22df0dc" containerName="revoke-keys"
Jul 30 23:15:00.142208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142169    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:15:00.142208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.142176    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:15:00.144678 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.144662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"
Jul 30 23:15:00.147614 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.147595    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:15:00.152987 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.152961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"]
Jul 30 23:15:00.155921 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.155902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"
Jul 30 23:15:00.493697 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.493672    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"]
Jul 30 23:15:00.495341 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:15:00.495312    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36cc91b_a843_46de_bdd7_8e586362d6ec.slice/crio-95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553 WatchSource:0}: Error finding container 95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553: Status 404 returned error can't find the container with id 95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553
Jul 30 23:15:00.657400 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:00.657364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b" event={"ID":"a36cc91b-a843-46de-bdd7-8e586362d6ec","Type":"ContainerStarted","Data":"95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553"}
Jul 30 23:15:01.664979 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:01.664887    2559 generic.go:356] "Generic (PLEG): container finished" podID="a36cc91b-a843-46de-bdd7-8e586362d6ec" containerID="6ac395ac63405cd5b82ef6caac8db7948b15564a6b5e2fbcf4d1868297b96d23" exitCode=0
Jul 30 23:15:01.665342 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:01.664981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b" event={"ID":"a36cc91b-a843-46de-bdd7-8e586362d6ec","Type":"ContainerDied","Data":"6ac395ac63405cd5b82ef6caac8db7948b15564a6b5e2fbcf4d1868297b96d23"}
Jul 30 23:15:02.798923 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:02.798900    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"
Jul 30 23:15:03.680071 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:03.679984    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b"
Jul 30 23:15:03.680071 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:03.680019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-bpq5b" event={"ID":"a36cc91b-a843-46de-bdd7-8e586362d6ec","Type":"ContainerDied","Data":"95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553"}
Jul 30 23:15:03.680307 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:15:03.680076    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95b4ef317b12dac0f9d65e948fc2b949bb616b9741b3f8f9e67495353f111553"
Jul 30 23:16:19.442924 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:19.442846    2559 scope.go:117] "RemoveContainer" containerID="a2453f4d145c5399a50b302f8143338150bc59256d8ca856b4cc60bd0ae1be6d"
Jul 30 23:16:19.451781 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:19.451759    2559 scope.go:117] "RemoveContainer" containerID="4d0c78539eba24da97c7dfde1f2014765b9d287b0bfc5164ad66561ccb36da61"
Jul 30 23:16:37.709801 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.709765    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:16:37.710258 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.710185    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36cc91b-a843-46de-bdd7-8e586362d6ec" containerName="cleanup"
Jul 30 23:16:37.710258 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.710197    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36cc91b-a843-46de-bdd7-8e586362d6ec" containerName="cleanup"
Jul 30 23:16:37.710258 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.710217    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:16:37.710258 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.710225    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4403f3b7-2a5e-4ae6-83f5-9866fdb56b04" containerName="istio-proxy"
Jul 30 23:16:37.710394 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.710291    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36cc91b-a843-46de-bdd7-8e586362d6ec" containerName="cleanup"
Jul 30 23:16:37.713371 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.713355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.716006 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.715985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 23:16:37.716215 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.716202    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-604c6cd2-openshift-default-dockercfg-6f8hs\""
Jul 30 23:16:37.723365 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.723338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:16:37.794298 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794298 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794501 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794501 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794501 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxbvr\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794501 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.794632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.794554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895407 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895407 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbvr\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895662 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.895950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.896063 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.895948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.896149 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.896067    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.896149 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.896087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.896340 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.896314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.897980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.897957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.898197 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.898180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.903449 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.903421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:37.903942 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:37.903924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbvr\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr\") pod \"e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") " pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:38.024860 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.024824    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:38.165374 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.165343    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:16:38.167337 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:16:38.167303    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3476260_8bc9_4a78_8670_77c960eeefe8.slice/crio-68a3e5f5c556aa29c06c4da61de696841f103f40c2d3f52d3aaa6716ea6ebd69 WatchSource:0}: Error finding container 68a3e5f5c556aa29c06c4da61de696841f103f40c2d3f52d3aaa6716ea6ebd69: Status 404 returned error can't find the container with id 68a3e5f5c556aa29c06c4da61de696841f103f40c2d3f52d3aaa6716ea6ebd69
Jul 30 23:16:38.169633 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.169591    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:38.169723 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.169698    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:38.169767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.169741    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:38.202809 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:38.202779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerStarted","Data":"68a3e5f5c556aa29c06c4da61de696841f103f40c2d3f52d3aaa6716ea6ebd69"}
Jul 30 23:16:39.209806 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:39.209761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerStarted","Data":"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"}
Jul 30 23:16:39.232606 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:39.232547    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podStartSLOduration=2.232528556 podStartE2EDuration="2.232528556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:16:39.231719429 +0000 UTC m=+2180.496965366" watchObservedRunningTime="2026-07-30 23:16:39.232528556 +0000 UTC m=+2180.497774495"
Jul 30 23:16:40.025293 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:40.025252    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:40.030119 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:40.030074    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:40.104334 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:40.104291    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:16:40.215820 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:40.215786    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:40.216862 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:40.216842    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:48.492226 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:48.492183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:16:55.225204 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.224680    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:35610->10.133.0.58:15021: read: connection reset by peer" start-of-body=
Jul 30 23:16:55.225204 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.224766    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:35610->10.133.0.58:15021: read: connection reset by peer"
Jul 30 23:16:55.306000 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.305968    2559 generic.go:356] "Generic (PLEG): container finished" podID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerID="f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff" exitCode=0
Jul 30 23:16:55.306207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.306026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerDied","Data":"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"}
Jul 30 23:16:55.306440 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.306425    2559 scope.go:117] "RemoveContainer" containerID="f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"
Jul 30 23:16:55.307453 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.307421    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:55.307556 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.307493    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:55.307556 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:55.307549    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:16:56.313925 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:56.313880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerStarted","Data":"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"}
Jul 30 23:16:57.025538 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:57.025503    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:16:57.025931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:57.025837    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 30 23:16:57.026127 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:57.026077    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 30 23:16:58.025470 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:58.025433    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 30 23:16:58.026068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:58.026034    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 30 23:16:59.025759 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:59.025718    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 30 23:16:59.026298 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:16:59.025790    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 30 23:17:00.025632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:00.025588    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 30 23:17:00.025852 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:00.025671    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 30 23:17:01.026665 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:01.026627    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 30 23:17:01.027660 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:01.027258    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 30 23:17:02.028699 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:02.028664    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:17:02.029054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:02.028957    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:17:02.029616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:02.029602    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:17:19.476978 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:19.476947    2559 scope.go:117] "RemoveContainer" containerID="41bab5dc6214de0e98640e6d837c7642dffc9a812c5281e36d98deecb6b80564"
Jul 30 23:17:24.106485 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:24.106449    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:17:40.596245 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:40.596151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:17:51.161075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.161036    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"]
Jul 30 23:17:51.164859 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.164841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:51.167536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.167506    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:17:51.167722 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.167507    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:17:51.172061 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.172029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"]
Jul 30 23:17:51.192785 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.192749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-604c6cd2-247ls\" (UID: \"23026b78-1f07-45ad-8cc3-7ea5f70096cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:51.294167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.294090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-604c6cd2-247ls\" (UID: \"23026b78-1f07-45ad-8cc3-7ea5f70096cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:51.294717 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.294695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-604c6cd2-247ls\" (UID: \"23026b78-1f07-45ad-8cc3-7ea5f70096cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:51.476731 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.476644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:51.620546 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.620516    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"]
Jul 30 23:17:51.622008 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:17:51.621973    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23026b78_1f07_45ad_8cc3_7ea5f70096cc.slice/crio-41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7 WatchSource:0}: Error finding container 41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7: Status 404 returned error can't find the container with id 41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7
Jul 30 23:17:51.639034 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:51.639001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls" event={"ID":"23026b78-1f07-45ad-8cc3-7ea5f70096cc","Type":"ContainerStarted","Data":"41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7"}
Jul 30 23:17:52.646441 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:52.646350    2559 generic.go:356] "Generic (PLEG): container finished" podID="23026b78-1f07-45ad-8cc3-7ea5f70096cc" containerID="2e02ed41da37d8a7cf701eccd2f14e54e60f23ebcaaf0667cef1d256ce7e786f" exitCode=0
Jul 30 23:17:52.646804 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:52.646437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls" event={"ID":"23026b78-1f07-45ad-8cc3-7ea5f70096cc","Type":"ContainerDied","Data":"2e02ed41da37d8a7cf701eccd2f14e54e60f23ebcaaf0667cef1d256ce7e786f"}
Jul 30 23:17:53.783688 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:53.783661    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:53.824852 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:53.824810    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca\") pod \"23026b78-1f07-45ad-8cc3-7ea5f70096cc\" (UID: \"23026b78-1f07-45ad-8cc3-7ea5f70096cc\") "
Jul 30 23:17:53.825240 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:53.825218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23026b78-1f07-45ad-8cc3-7ea5f70096cc" (UID: "23026b78-1f07-45ad-8cc3-7ea5f70096cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:17:53.926140 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:53.926040    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23026b78-1f07-45ad-8cc3-7ea5f70096cc-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:17:54.658730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:54.658699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"
Jul 30 23:17:54.658969 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:54.658698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls" event={"ID":"23026b78-1f07-45ad-8cc3-7ea5f70096cc","Type":"ContainerDied","Data":"41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7"}
Jul 30 23:17:54.658969 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:17:54.658829    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41547e76d763341adfe77bc23c3f7daa6d9048622d199aa559cca66da1db2ee7"
Jul 30 23:18:04.396311 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:04.396276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:18:06.769372 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:06.769335    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"]
Jul 30 23:18:06.771503 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:06.771471    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-604c6cd2-247ls"]
Jul 30 23:18:07.241004 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:07.240960    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23026b78-1f07-45ad-8cc3-7ea5f70096cc" path="/var/lib/kubelet/pods/23026b78-1f07-45ad-8cc3-7ea5f70096cc/volumes"
Jul 30 23:18:11.999580 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:11.999543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:18:19.502729 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:19.502692    2559 scope.go:117] "RemoveContainer" containerID="9455926296e6682e08f853a1e4b6acf962c994b554ea67aca1a37d3090a0db28"
Jul 30 23:18:58.092231 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:58.092194    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:18:58.092757 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:18:58.092417    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" containerID="cri-o://7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7" gracePeriod=30
Jul 30 23:19:00.006990 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:00.006954    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:19:02.031555 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:02.031508    2559 patch_prober.go:28] interesting pod/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:19:02.031944 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:02.031604    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:19:03.344983 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.344959    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:19:03.449303 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449303 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449303 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449293    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449358    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449387    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxbvr\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449501    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token\") pod \"a3476260-8bc9-4a78-8670-77c960eeefe8\" (UID: \"a3476260-8bc9-4a78-8670-77c960eeefe8\") "
Jul 30 23:19:03.449629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449590    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449699    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449859    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449878    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449891    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.449991 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.449900    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.450301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.450233    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:19:03.451634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.451608    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr" (OuterVolumeSpecName: "kube-api-access-bxbvr") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "kube-api-access-bxbvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:19:03.451634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.451611    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:19:03.452234 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.452215    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:19:03.452234 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.452226    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3476260-8bc9-4a78-8670-77c960eeefe8" (UID: "a3476260-8bc9-4a78-8670-77c960eeefe8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:19:03.551084 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.551050    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.551084 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.551079    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.551284 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.551091    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxbvr\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-kube-api-access-bxbvr\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.551284 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.551130    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3476260-8bc9-4a78-8670-77c960eeefe8-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:03.551284 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:03.551142    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3476260-8bc9-4a78-8670-77c960eeefe8-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:19:04.049586 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.049550    2559 generic.go:356] "Generic (PLEG): container finished" podID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerID="7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7" exitCode=0
Jul 30 23:19:04.049772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.049595    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"
Jul 30 23:19:04.049772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.049633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerDied","Data":"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"}
Jul 30 23:19:04.049772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.049688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx" event={"ID":"a3476260-8bc9-4a78-8670-77c960eeefe8","Type":"ContainerDied","Data":"68a3e5f5c556aa29c06c4da61de696841f103f40c2d3f52d3aaa6716ea6ebd69"}
Jul 30 23:19:04.049772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.049717    2559 scope.go:117] "RemoveContainer" containerID="7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"
Jul 30 23:19:04.059727 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.059710    2559 scope.go:117] "RemoveContainer" containerID="f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"
Jul 30 23:19:04.070836 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.070812    2559 scope.go:117] "RemoveContainer" containerID="7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"
Jul 30 23:19:04.071261 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:19:04.071240    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7\": container with ID starting with 7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7 not found: ID does not exist" containerID="7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"
Jul 30 23:19:04.071382 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.071273    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7"} err="failed to get container status \"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7\": rpc error: code = NotFound desc = could not find container \"7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7\": container with ID starting with 7c57a0465cf266c3bdc9268b7e1259f2128ae26c36a19b8d08ed47078bfb93e7 not found: ID does not exist"
Jul 30 23:19:04.071382 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.071298    2559 scope.go:117] "RemoveContainer" containerID="f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"
Jul 30 23:19:04.071684 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:19:04.071667    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff\": container with ID starting with f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff not found: ID does not exist" containerID="f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"
Jul 30 23:19:04.071743 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.071696    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff"} err="failed to get container status \"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff\": rpc error: code = NotFound desc = could not find container \"f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff\": container with ID starting with f2ec194834e3f8c84f72407af64056986ddbf2f1a70e9792e276dd763c837fff not found: ID does not exist"
Jul 30 23:19:04.073500 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.073477    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:19:04.075553 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:04.075534    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-604c6cd2-openshift-default-647d59497b-mknbx"]
Jul 30 23:19:05.240310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:05.240278    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" path="/var/lib/kubelet/pods/a3476260-8bc9-4a78-8670-77c960eeefe8/volumes"
Jul 30 23:19:11.411832 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:11.411747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:19:18.700131 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:18.700074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:19:28.302584 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:19:28.302547    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:20:04.341742 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.341711    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:20:04.342214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342075    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:04.342214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342085    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:04.342214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342113    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23026b78-1f07-45ad-8cc3-7ea5f70096cc" containerName="revoke-keys"
Jul 30 23:20:04.342214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342122    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23026b78-1f07-45ad-8cc3-7ea5f70096cc" containerName="revoke-keys"
Jul 30 23:20:04.342214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342212    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23026b78-1f07-45ad-8cc3-7ea5f70096cc" containerName="revoke-keys"
Jul 30 23:20:04.342376 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342222    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:04.342376 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.342229    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:04.345335 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.345320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.347933 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.347913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fe64f5-openshift-default-dockercfg-5c94p\""
Jul 30 23:20:04.348055 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.347913    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 23:20:04.356576 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.356555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:20:04.391792 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.391762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlchs\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.395125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.392599    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.493828 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlchs\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.493828 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.493997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494459 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494459 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494459 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.494790 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.494762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.496929 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.496901    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.497132 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.497113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.501698 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.501679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.501889 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.501871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlchs\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs\") pod \"e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") " pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.656387 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.656301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:04.818261 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.818215    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:20:04.818395 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:20:04.818321    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8868b348_1688_42ad_91bf_30a2b12eff2c.slice/crio-7b903495f72f3df83de3f3a56415e13a7a321e4c0d362be6c4a51aabf34987de WatchSource:0}: Error finding container 7b903495f72f3df83de3f3a56415e13a7a321e4c0d362be6c4a51aabf34987de: Status 404 returned error can't find the container with id 7b903495f72f3df83de3f3a56415e13a7a321e4c0d362be6c4a51aabf34987de
Jul 30 23:20:04.820394 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.820361    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:04.820499 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.820425    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:04.820499 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:04.820454    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:05.391783 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:05.391748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerStarted","Data":"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"}
Jul 30 23:20:05.392403 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:05.391805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerStarted","Data":"7b903495f72f3df83de3f3a56415e13a7a321e4c0d362be6c4a51aabf34987de"}
Jul 30 23:20:05.415192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:05.415129    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podStartSLOduration=1.415110269 podStartE2EDuration="1.415110269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:20:05.412497535 +0000 UTC m=+2386.677743453" watchObservedRunningTime="2026-07-30 23:20:05.415110269 +0000 UTC m=+2386.680356200"
Jul 30 23:20:05.657154 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:05.657044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:05.661587 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:05.661562    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:06.397359 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:06.397329    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:06.398364 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:06.398344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:11.904381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:11.904349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:20:19.538183 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:19.538150    2559 scope.go:117] "RemoveContainer" containerID="6af8f53475bf20e693257a14602cd382715f9302d19e3bdf5d16fbbdc4d1827b"
Jul 30 23:20:21.398507 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.398431    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:21.398925 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.398499    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:21.488643 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.488617    2559 generic.go:356] "Generic (PLEG): container finished" podID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerID="38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4" exitCode=0
Jul 30 23:20:21.488819 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.488700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerDied","Data":"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"}
Jul 30 23:20:21.489083 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.489068    2559 scope.go:117] "RemoveContainer" containerID="38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"
Jul 30 23:20:21.490048 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.490021    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:21.490149 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.490087    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:21.490149 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:21.490136    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:22.497408 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:22.497377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerStarted","Data":"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"}
Jul 30 23:20:22.657260 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:22.657226    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:22.657447 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:22.657395    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:22.657497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:22.657440    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:23.657636 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:23.657605    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:23.658024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:23.657656    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:24.657213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:24.657176    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:24.657422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:24.657237    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:25.657504 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:25.657472    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:25.657886 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:25.657527    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:26.657477 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:26.657435    2559 patch_prober.go:28] interesting pod/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 23:20:26.657676 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:26.657495    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 23:20:27.660569 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:27.660537    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:27.661007 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:27.660817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:27.661478 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:27.661463    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:20:33.122728 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.122695    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:20:33.123208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.123078    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:33.123208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.123165    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3476260-8bc9-4a78-8670-77c960eeefe8" containerName="istio-proxy"
Jul 30 23:20:33.126890 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.126856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.131399 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.131379    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-04f0cc-openshift-default-dockercfg-88rrg\""
Jul 30 23:20:33.138063 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.138036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:20:33.257987 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.257951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.257987 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.257989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258207 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.258388 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.258218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mkl\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359584 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359789 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mkl\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359789 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359789 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359943 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359943 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359943 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.359943 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360185 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360185 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.359985    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360185 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.360001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.360209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360557 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.360536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.360628 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.360569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.362387 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.362367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.362625 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.362608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.367851 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.367828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mkl\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.367945 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.367853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token\") pod \"e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") " pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.444060 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.443987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:33.581368 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.581341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:20:33.582138 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:20:33.582084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4834221f_e7a7_4f02_a84a_920ee79de2dc.slice/crio-990e6ea1e343ad2959a60375f599b8e0b73a880944c02172a2dbfef9521d7ed6 WatchSource:0}: Error finding container 990e6ea1e343ad2959a60375f599b8e0b73a880944c02172a2dbfef9521d7ed6: Status 404 returned error can't find the container with id 990e6ea1e343ad2959a60375f599b8e0b73a880944c02172a2dbfef9521d7ed6
Jul 30 23:20:33.584394 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.584365    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:33.584462 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.584425    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:33.584462 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:33.584453    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:34.572508 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:34.572471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerStarted","Data":"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"}
Jul 30 23:20:34.573003 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:34.572532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerStarted","Data":"990e6ea1e343ad2959a60375f599b8e0b73a880944c02172a2dbfef9521d7ed6"}
Jul 30 23:20:34.593379 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:34.593331    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podStartSLOduration=1.59331692 podStartE2EDuration="1.59331692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:20:34.591132444 +0000 UTC m=+2415.856378380" watchObservedRunningTime="2026-07-30 23:20:34.59331692 +0000 UTC m=+2415.858562856"
Jul 30 23:20:35.445192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:35.445158    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:35.449869 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:35.449845    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:35.578579 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:35.578545    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:35.579702 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:35.579680    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:40.302346 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:40.302265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:20:50.579613 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.579578    2559 patch_prober.go:28] interesting pod/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 23:20:50.580022 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.579635    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 23:20:50.675936 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.675901    2559 generic.go:356] "Generic (PLEG): container finished" podID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerID="c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847" exitCode=0
Jul 30 23:20:50.676091 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.675975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerDied","Data":"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"}
Jul 30 23:20:50.676376 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.676361    2559 scope.go:117] "RemoveContainer" containerID="c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"
Jul 30 23:20:50.677393 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.677365    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:50.677454 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.677430    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:50.677490 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:50.677463    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:20:51.683182 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:51.683148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerStarted","Data":"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"}
Jul 30 23:20:52.445062 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:52.445023    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:52.445299 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:52.445275    2559 patch_prober.go:28] interesting pod/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 23:20:52.445366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:52.445325    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 23:20:53.445265 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:53.445224    2559 patch_prober.go:28] interesting pod/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 23:20:53.445632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:53.445294    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 23:20:54.445002 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:54.444964    2559 patch_prober.go:28] interesting pod/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 23:20:54.445197 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:54.445029    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 23:20:55.445046 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:55.445014    2559 patch_prober.go:28] interesting pod/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 23:20:55.445439 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:55.445078    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 23:20:56.450287 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:56.450249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:56.450725 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:56.450642    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:20:56.451561 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:20:56.451540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:21:33.603287 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:21:33.603252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:21:40.697803 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:21:40.697766    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:22:03.101273 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:03.101231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:22:14.494747 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:14.494654    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:22:43.195499 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.195456    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"]
Jul 30 23:22:43.199106 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.199076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:43.201698 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.201675    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:22:43.201845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.201707    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:22:43.207791 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.207745    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"]
Jul 30 23:22:43.268331 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.268293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm\" (UID: \"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:43.369567 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.369532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm\" (UID: \"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:43.370226 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.370205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm\" (UID: \"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:43.512127 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.512061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:43.659323 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:43.659292    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"]
Jul 30 23:22:43.660928 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:22:43.660899    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdc9ad5_f0ae_48c6_8ed3_9443f81c8b76.slice/crio-f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf WatchSource:0}: Error finding container f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf: Status 404 returned error can't find the container with id f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf
Jul 30 23:22:44.331468 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:44.331434    2559 generic.go:356] "Generic (PLEG): container finished" podID="6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" containerID="f60306653adc3217985cf7077f575a7a0013ec9728360204e8272347883930fb" exitCode=0
Jul 30 23:22:44.331872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:44.331496    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm" event={"ID":"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76","Type":"ContainerDied","Data":"f60306653adc3217985cf7077f575a7a0013ec9728360204e8272347883930fb"}
Jul 30 23:22:44.331872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:44.331538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm" event={"ID":"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76","Type":"ContainerStarted","Data":"f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf"}
Jul 30 23:22:45.477265 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:45.477234    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:45.591285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:45.591197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca\") pod \"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76\" (UID: \"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76\") "
Jul 30 23:22:45.591534 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:45.591511    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" (UID: "6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:22:45.691971 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:45.691935    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:22:45.700081 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:45.700049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:22:46.346921 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:46.346889    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"
Jul 30 23:22:46.347171 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:46.346931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm" event={"ID":"6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76","Type":"ContainerDied","Data":"f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf"}
Jul 30 23:22:46.347171 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:46.346976    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f84971dde3d80398919a82d834bc16d886c5b1405283cd4147b8ac6b75fa13cf"
Jul 30 23:22:53.958275 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:53.958228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"]
Jul 30 23:22:53.960690 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:53.960669    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-fe64f5-lk5wm"]
Jul 30 23:22:55.240764 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:55.240728    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" path="/var/lib/kubelet/pods/6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76/volumes"
Jul 30 23:22:56.100555 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:22:56.100491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:23:00.706327 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:00.706295    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:23:00.706766 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:00.706517    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy" containerID="cri-o://7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7" gracePeriod=30
Jul 30 23:23:05.968628 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:05.968595    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:23:06.076496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076449    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076498    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076549    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076701    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076757    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076862    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076890    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlchs\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs\") pod \"8868b348-1688-42ad-91bf-30a2b12eff2c\" (UID: \"8868b348-1688-42ad-91bf-30a2b12eff2c\") "
Jul 30 23:23:06.076980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.076951    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:23:06.077223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:06.077223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:06.077337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077258    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:06.077396 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077329    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.077396 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077367    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.077396 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077382    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.077396 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077395    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8868b348-1688-42ad-91bf-30a2b12eff2c-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.077609 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.077398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:06.078998 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.078976    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:23:06.079268 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.079242    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs" (OuterVolumeSpecName: "kube-api-access-rlchs") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "kube-api-access-rlchs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:23:06.079481 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.079460    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:06.079552 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.079457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8868b348-1688-42ad-91bf-30a2b12eff2c" (UID: "8868b348-1688-42ad-91bf-30a2b12eff2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:23:06.178305 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.178266    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlchs\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-kube-api-access-rlchs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.178305 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.178299    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.178305 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.178309    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.178305 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.178317    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8868b348-1688-42ad-91bf-30a2b12eff2c-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.178599 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.178327    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8868b348-1688-42ad-91bf-30a2b12eff2c-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:06.461201 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.461078    2559 generic.go:356] "Generic (PLEG): container finished" podID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerID="7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7" exitCode=0
Jul 30 23:23:06.461201 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.461140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerDied","Data":"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"}
Jul 30 23:23:06.461201 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.461165    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"
Jul 30 23:23:06.461201 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.461186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg" event={"ID":"8868b348-1688-42ad-91bf-30a2b12eff2c","Type":"ContainerDied","Data":"7b903495f72f3df83de3f3a56415e13a7a321e4c0d362be6c4a51aabf34987de"}
Jul 30 23:23:06.461544 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.461208    2559 scope.go:117] "RemoveContainer" containerID="7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"
Jul 30 23:23:06.471974 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.471952    2559 scope.go:117] "RemoveContainer" containerID="38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"
Jul 30 23:23:06.482411 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.482385    2559 scope.go:117] "RemoveContainer" containerID="7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"
Jul 30 23:23:06.482790 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:23:06.482762    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7\": container with ID starting with 7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7 not found: ID does not exist" containerID="7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"
Jul 30 23:23:06.482885 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.482803    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7"} err="failed to get container status \"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7\": rpc error: code = NotFound desc = could not find container \"7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7\": container with ID starting with 7f7fd96910008c748208dfe3ddd02a7b46429415bc0896883786bd4b95aec4b7 not found: ID does not exist"
Jul 30 23:23:06.482885 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.482830    2559 scope.go:117] "RemoveContainer" containerID="38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"
Jul 30 23:23:06.483174 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:23:06.483154    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4\": container with ID starting with 38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4 not found: ID does not exist" containerID="38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"
Jul 30 23:23:06.483224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.483183    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4"} err="failed to get container status \"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4\": rpc error: code = NotFound desc = could not find container \"38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4\": container with ID starting with 38c4c159fe2f7cc417aa4f0949dde1f56521a83657421adfb7c3720356a139e4 not found: ID does not exist"
Jul 30 23:23:06.485164 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.485134    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:23:06.488050 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:06.488020    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fe64f5-openshift-default-5c98ccc58b-mcffg"]
Jul 30 23:23:07.240731 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:07.240695    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" path="/var/lib/kubelet/pods/8868b348-1688-42ad-91bf-30a2b12eff2c/volumes"
Jul 30 23:23:13.590010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:13.589965    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:23:18.254585 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:18.254548    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:23:18.255152 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:18.254848    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy" containerID="cri-o://daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1" gracePeriod=30
Jul 30 23:23:19.200210 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200167    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:23:19.200768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200751    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" containerName="revoke-keys"
Jul 30 23:23:19.200819 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200771    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" containerName="revoke-keys"
Jul 30 23:23:19.200819 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200790    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:19.200819 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200799    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:19.200929 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200918    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:19.200966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200934    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:19.200966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.200947    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fdc9ad5-f0ae-48c6-8ed3-9443f81c8b76" containerName="revoke-keys"
Jul 30 23:23:19.205969 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.205946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.209062 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.209034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-356bb8-openshift-default-dockercfg-qpn6j\""
Jul 30 23:23:19.211947 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.211908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:23:19.297040 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.296989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xnr\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.297789 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.297562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399007 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.398956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399007 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xnr\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399650 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399650 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399650 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.399797 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.399718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.400153 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.400127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.401674 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.401645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.402380 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.402362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.406796 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.406768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.406894 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.406826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xnr\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr\") pod \"e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") " pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.519155 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.519070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:19.665702 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.665677    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:23:19.667437 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:23:19.667407    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6bcef8_f00b_480a_b2f4_4b2232862bdd.slice/crio-3d84bb79d509dfc545d1adbb044f1bb0c22d9385cd4d7c86b1e818b00d8d73b2 WatchSource:0}: Error finding container 3d84bb79d509dfc545d1adbb044f1bb0c22d9385cd4d7c86b1e818b00d8d73b2: Status 404 returned error can't find the container with id 3d84bb79d509dfc545d1adbb044f1bb0c22d9385cd4d7c86b1e818b00d8d73b2
Jul 30 23:23:19.669576 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.669543    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:19.669673 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.669609    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:19.669673 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:19.669634    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:20.558547 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:20.558514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerStarted","Data":"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"}
Jul 30 23:23:20.558948 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:20.558567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerStarted","Data":"3d84bb79d509dfc545d1adbb044f1bb0c22d9385cd4d7c86b1e818b00d8d73b2"}
Jul 30 23:23:20.581966 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:20.581905    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podStartSLOduration=1.581886805 podStartE2EDuration="1.581886805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:23:20.579240313 +0000 UTC m=+2581.844486252" watchObservedRunningTime="2026-07-30 23:23:20.581886805 +0000 UTC m=+2581.847132742"
Jul 30 23:23:21.519309 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:21.519273    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:21.524730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:21.524702    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:21.564538 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:21.564504    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:21.565680 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:21.565658    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:23.519489 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.519411    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:23:23.577001 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.576960    2559 generic.go:356] "Generic (PLEG): container finished" podID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerID="daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1" exitCode=0
Jul 30 23:23:23.577259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.577026    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"
Jul 30 23:23:23.577259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.577053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerDied","Data":"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"}
Jul 30 23:23:23.577259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.577132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45" event={"ID":"4834221f-e7a7-4f02-a84a-920ee79de2dc","Type":"ContainerDied","Data":"990e6ea1e343ad2959a60375f599b8e0b73a880944c02172a2dbfef9521d7ed6"}
Jul 30 23:23:23.577259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.577158    2559 scope.go:117] "RemoveContainer" containerID="daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"
Jul 30 23:23:23.587145 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.587122    2559 scope.go:117] "RemoveContainer" containerID="c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"
Jul 30 23:23:23.596687 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.596664    2559 scope.go:117] "RemoveContainer" containerID="daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"
Jul 30 23:23:23.597031 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:23:23.597008    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1\": container with ID starting with daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1 not found: ID does not exist" containerID="daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"
Jul 30 23:23:23.597167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.597044    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1"} err="failed to get container status \"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1\": rpc error: code = NotFound desc = could not find container \"daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1\": container with ID starting with daaec12c349949a1131a27395da6a8a31ddb210adc9e589f26c420ee1406fdb1 not found: ID does not exist"
Jul 30 23:23:23.597167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.597070    2559 scope.go:117] "RemoveContainer" containerID="c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"
Jul 30 23:23:23.597391 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:23:23.597373    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847\": container with ID starting with c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847 not found: ID does not exist" containerID="c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"
Jul 30 23:23:23.597437 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.597400    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847"} err="failed to get container status \"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847\": rpc error: code = NotFound desc = could not find container \"c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847\": container with ID starting with c41bec08feefa4c7013ce36ce13258b3a52c1b346b9651e33be76f55deec8847 not found: ID does not exist"
Jul 30 23:23:23.639754 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639714    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.639754 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639760    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639786    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4mkl\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639902    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639953    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.639999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640044    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640074    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket\") pod \"4834221f-e7a7-4f02-a84a-920ee79de2dc\" (UID: \"4834221f-e7a7-4f02-a84a-920ee79de2dc\") "
Jul 30 23:23:23.640310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:23.640310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:23.640539 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640434    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:23.640606 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640566    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.640606 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640586    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.640606 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640600    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.641064 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.641040    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:23.641172 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.640632    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:23:23.642412 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.642381    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:23:23.642412 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.642400    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:23:23.642725 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.642697    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl" (OuterVolumeSpecName: "kube-api-access-l4mkl") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "kube-api-access-l4mkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:23:23.642725 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.642697    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4834221f-e7a7-4f02-a84a-920ee79de2dc" (UID: "4834221f-e7a7-4f02-a84a-920ee79de2dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:23:23.741085 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741039    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4834221f-e7a7-4f02-a84a-920ee79de2dc-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.741085 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741074    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.741085 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741086    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.741358 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741129    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.741358 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741141    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4mkl\" (UniqueName: \"kubernetes.io/projected/4834221f-e7a7-4f02-a84a-920ee79de2dc-kube-api-access-l4mkl\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.741358 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.741155    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4834221f-e7a7-4f02-a84a-920ee79de2dc-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:23:23.899845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.899810    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:23:23.904127 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:23.904078    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-04f0cc-openshift-default-6bc548fc84-tcb45"]
Jul 30 23:23:25.241645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:25.241610    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" path="/var/lib/kubelet/pods/4834221f-e7a7-4f02-a84a-920ee79de2dc/volumes"
Jul 30 23:23:25.691906 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:25.691806    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:23:35.649345 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.649309    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerID="416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a" exitCode=0
Jul 30 23:23:35.649805 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.649385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerDied","Data":"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"}
Jul 30 23:23:35.649805 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.649795    2559 scope.go:117] "RemoveContainer" containerID="416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"
Jul 30 23:23:35.650825 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.650798    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:35.650892 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.650868    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:35.650938 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:35.650904    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:36.565417 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:36.565382    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:36.658328 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:36.658284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerStarted","Data":"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"}
Jul 30 23:23:37.521064 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:37.521013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:37.521318 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:37.521189    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 23:23:37.521318 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:37.521242    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 23:23:38.520381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:38.520331    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 23:23:38.520924 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:38.520406    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 23:23:39.520443 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:39.520391    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 23:23:39.520945 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:39.520476    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 23:23:40.519978 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:40.519933    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 23:23:40.520232 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:40.520029    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 23:23:41.519601 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:41.519562    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 23:23:41.520208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:41.520175    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 23:23:42.523767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:42.523726    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:42.524272 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:42.524135    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:42.524773 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:42.524755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:23:48.378561 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.378519    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:23:48.379188 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379165    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.379244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379192    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.379244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379207    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.379244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379216    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.379244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379230    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:48.379244 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379240    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8868b348-1688-42ad-91bf-30a2b12eff2c" containerName="istio-proxy"
Jul 30 23:23:48.379400 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379372    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.379400 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.379388    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4834221f-e7a7-4f02-a84a-920ee79de2dc" containerName="istio-proxy"
Jul 30 23:23:48.382165 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.382142    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.385015 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.384991    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1ed561-openshift-default-dockercfg-t8kv8\""
Jul 30 23:23:48.397515 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.397487    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:23:48.470759 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.470953 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.470953 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.470953 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.470953 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.471223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.470951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f4l\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.471223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.471017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.471223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.471131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.471223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.471181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.571947 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.571908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.571947 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.571949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.571971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f4l\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572263 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572646 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572646 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572646 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572970 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.572970 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.572925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.574528 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.574499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.574770 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.574749    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.583928 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.583899    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.584141 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.584089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f4l\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l\") pod \"e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") " pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.693133 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.693021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:48.849527 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.849496    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:23:48.851132 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:23:48.851089    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3891225e_6852_4434_8834_3d5bd96f311c.slice/crio-d2ed318b1ca1b63b63788183a951bbde9537a884cf1efe1c9365e702107e4272 WatchSource:0}: Error finding container d2ed318b1ca1b63b63788183a951bbde9537a884cf1efe1c9365e702107e4272: Status 404 returned error can't find the container with id d2ed318b1ca1b63b63788183a951bbde9537a884cf1efe1c9365e702107e4272
Jul 30 23:23:48.853203 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.853171    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:48.853277 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.853239    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:48.853277 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:48.853266    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:23:49.731287 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:49.731248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerStarted","Data":"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"}
Jul 30 23:23:49.731742 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:49.731304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerStarted","Data":"d2ed318b1ca1b63b63788183a951bbde9537a884cf1efe1c9365e702107e4272"}
Jul 30 23:23:49.760742 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:49.760693    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podStartSLOduration=1.760679128 podStartE2EDuration="1.760679128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:23:49.759010017 +0000 UTC m=+2611.024255957" watchObservedRunningTime="2026-07-30 23:23:49.760679128 +0000 UTC m=+2611.025925066"
Jul 30 23:23:50.693337 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:50.693296    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:50.698802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:50.698776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:50.737068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:50.737034    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:50.738178 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:50.738158    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:23:56.599029 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:23:56.598991    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:24:05.738936 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.738900    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:05.739437 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.738961    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:05.825360 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.825326    2559 generic.go:356] "Generic (PLEG): container finished" podID="3891225e-6852-4434-8834-3d5bd96f311c" containerID="2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2" exitCode=0
Jul 30 23:24:05.825529 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.825404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerDied","Data":"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"}
Jul 30 23:24:05.825860 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.825846    2559 scope.go:117] "RemoveContainer" containerID="2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"
Jul 30 23:24:05.826931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.826905    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:24:05.826989 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.826974    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:24:05.827029 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:05.827002    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:24:06.838203 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:06.837452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerStarted","Data":"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"}
Jul 30 23:24:07.693574 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:07.693538    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:24:07.693757 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:07.693736    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:07.693822 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:07.693782    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:08.693715 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:08.693676    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:08.694248 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:08.693735    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:09.693688 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:09.693647    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:09.693892 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:09.693707    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:10.694404 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:10.694362    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:10.694885 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:10.694437    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:11.694462 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:11.694417    2559 patch_prober.go:28] interesting pod/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 30 23:24:11.694845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:11.694480    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 30 23:24:12.698247 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:12.698214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:24:12.698646 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:12.698626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:24:12.699350 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:12.699330    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:24:19.597813 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.597777    2559 scope.go:117] "RemoveContainer" containerID="2e02ed41da37d8a7cf701eccd2f14e54e60f23ebcaaf0667cef1d256ce7e786f"
Jul 30 23:24:19.901419 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.901326    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"]
Jul 30 23:24:19.904928 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.904900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:19.907535 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.907511    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:24:19.908569 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.908542    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:24:19.912887 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.912828    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"]
Jul 30 23:24:19.961667 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:19.961626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q\" (UID: \"0cb8df5b-76b8-438c-b199-6dbc443aefca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:20.063148 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.063073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q\" (UID: \"0cb8df5b-76b8-438c-b199-6dbc443aefca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:20.063709 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.063687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q\" (UID: \"0cb8df5b-76b8-438c-b199-6dbc443aefca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:20.218873 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.218780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:20.359946 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.359918    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"]
Jul 30 23:24:20.362159 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:24:20.362084    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb8df5b_76b8_438c_b199_6dbc443aefca.slice/crio-f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2 WatchSource:0}: Error finding container f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2: Status 404 returned error can't find the container with id f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2
Jul 30 23:24:20.931536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.931438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q" event={"ID":"0cb8df5b-76b8-438c-b199-6dbc443aefca","Type":"ContainerStarted","Data":"76c4c50e4e93f4142133dd297e26ec1111a8e2c552ecd3fc4e405f864e806491"}
Jul 30 23:24:20.931536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.931503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q" event={"ID":"0cb8df5b-76b8-438c-b199-6dbc443aefca","Type":"ContainerStarted","Data":"f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2"}
Jul 30 23:24:20.952313 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:20.952255    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q" podStartSLOduration=1.952232696 podStartE2EDuration="1.952232696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:24:20.950215304 +0000 UTC m=+2642.215461241" watchObservedRunningTime="2026-07-30 23:24:20.952232696 +0000 UTC m=+2642.217478636"
Jul 30 23:24:21.937873 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:21.937834    2559 generic.go:356] "Generic (PLEG): container finished" podID="0cb8df5b-76b8-438c-b199-6dbc443aefca" containerID="76c4c50e4e93f4142133dd297e26ec1111a8e2c552ecd3fc4e405f864e806491" exitCode=0
Jul 30 23:24:21.938289 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:21.937914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q" event={"ID":"0cb8df5b-76b8-438c-b199-6dbc443aefca","Type":"ContainerDied","Data":"76c4c50e4e93f4142133dd297e26ec1111a8e2c552ecd3fc4e405f864e806491"}
Jul 30 23:24:23.087345 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.087319    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:23.191986 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.191951    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca\") pod \"0cb8df5b-76b8-438c-b199-6dbc443aefca\" (UID: \"0cb8df5b-76b8-438c-b199-6dbc443aefca\") "
Jul 30 23:24:23.192377 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.192351    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0cb8df5b-76b8-438c-b199-6dbc443aefca" (UID: "0cb8df5b-76b8-438c-b199-6dbc443aefca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:24:23.293474 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.293439    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb8df5b-76b8-438c-b199-6dbc443aefca-maas-api-service-ca\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:23.951769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.951735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"
Jul 30 23:24:23.951932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.951769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q" event={"ID":"0cb8df5b-76b8-438c-b199-6dbc443aefca","Type":"ContainerDied","Data":"f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2"}
Jul 30 23:24:23.951932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:23.951843    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f58eabd356786dcdc76e4cd0637caeba11e8b89e1fb041f2ffeee9230f74cec2"
Jul 30 23:24:35.514932 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:35.514890    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"]
Jul 30 23:24:35.517475 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:35.517446    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-356bb8-lkw9q"]
Jul 30 23:24:36.795621 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:36.795583    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:24:37.241039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:37.240994    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb8df5b-76b8-438c-b199-6dbc443aefca" path="/var/lib/kubelet/pods/0cb8df5b-76b8-438c-b199-6dbc443aefca/volumes"
Jul 30 23:24:42.055285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:42.055248    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:24:42.055784 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:42.055479    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" containerID="cri-o://e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5" gracePeriod=30
Jul 30 23:24:42.526675 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:42.526639    2559 patch_prober.go:28] interesting pod/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:24:42.526844 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:42.526699    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:24:47.321202 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.321136    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:24:47.420915 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.420880    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.420915 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.420921    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.420958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421147 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421074    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421269 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5xnr\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421269 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421269 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421223    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421269 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421241    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:24:47.421269 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421533 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421275    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:24:47.421533 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421301    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket\") pod \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\" (UID: \"0f6bcef8-f00b-480a-b2f4-4b2232862bdd\") "
Jul 30 23:24:47.421533 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:24:47.421533 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:24:47.421694 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421628    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:24:47.421733 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421692    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.421733 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421717    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.421820 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421734    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.421820 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.421746    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.423488 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.423455    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr" (OuterVolumeSpecName: "kube-api-access-q5xnr") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "kube-api-access-q5xnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:24:47.423488 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.423459    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:24:47.423926 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.423901    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:24:47.423926 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.423907    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f6bcef8-f00b-480a-b2f4-4b2232862bdd" (UID: "0f6bcef8-f00b-480a-b2f4-4b2232862bdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:24:47.522755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.522714    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.522755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.522746    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.522755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.522757    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.522755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.522767    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:47.523045 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:47.522776    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5xnr\" (UniqueName: \"kubernetes.io/projected/0f6bcef8-f00b-480a-b2f4-4b2232862bdd-kube-api-access-q5xnr\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:24:48.101981 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.101947    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerID="e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5" exitCode=0
Jul 30 23:24:48.102192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.101995    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"
Jul 30 23:24:48.102192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.102033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerDied","Data":"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"}
Jul 30 23:24:48.102192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.102092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt" event={"ID":"0f6bcef8-f00b-480a-b2f4-4b2232862bdd","Type":"ContainerDied","Data":"3d84bb79d509dfc545d1adbb044f1bb0c22d9385cd4d7c86b1e818b00d8d73b2"}
Jul 30 23:24:48.102192 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.102148    2559 scope.go:117] "RemoveContainer" containerID="e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"
Jul 30 23:24:48.113224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.113203    2559 scope.go:117] "RemoveContainer" containerID="416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"
Jul 30 23:24:48.122647 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.122459    2559 scope.go:117] "RemoveContainer" containerID="e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"
Jul 30 23:24:48.122954 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:24:48.122815    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5\": container with ID starting with e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5 not found: ID does not exist" containerID="e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"
Jul 30 23:24:48.122954 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.122856    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5"} err="failed to get container status \"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5\": rpc error: code = NotFound desc = could not find container \"e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5\": container with ID starting with e9af202bbe2c5a9cbffa9c436f6f70fd8da02695192d65f422ce13bc50cb70a5 not found: ID does not exist"
Jul 30 23:24:48.122954 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.122881    2559 scope.go:117] "RemoveContainer" containerID="416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"
Jul 30 23:24:48.123287 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:24:48.123262    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a\": container with ID starting with 416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a not found: ID does not exist" containerID="416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"
Jul 30 23:24:48.123333 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.123297    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a"} err="failed to get container status \"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a\": rpc error: code = NotFound desc = could not find container \"416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a\": container with ID starting with 416b1e3d9433c50be6854ee8de7e8caaff528950a2e5b5d2c006ae4c26d5790a not found: ID does not exist"
Jul 30 23:24:48.125246 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.125226    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:24:48.128619 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:48.128594    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-356bb8-openshift-default-7d9c875c76-xqlmt"]
Jul 30 23:24:49.240279 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:24:49.240246    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" path="/var/lib/kubelet/pods/0f6bcef8-f00b-480a-b2f4-4b2232862bdd/volumes"
Jul 30 23:25:00.102862 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:00.102824    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:25:04.605165 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:04.605128    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:25:04.605640 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:04.605399    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy" containerID="cri-o://2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3" gracePeriod=30
Jul 30 23:25:05.561259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561225    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:25:05.561683 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561666    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb8df5b-76b8-438c-b199-6dbc443aefca" containerName="revoke-keys"
Jul 30 23:25:05.561767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561686    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb8df5b-76b8-438c-b199-6dbc443aefca" containerName="revoke-keys"
Jul 30 23:25:05.561767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561705    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:05.561767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:05.561951 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:05.561951 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561839    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:05.561951 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.561855    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb8df5b-76b8-438c-b199-6dbc443aefca" containerName="revoke-keys"
Jul 30 23:25:05.565134 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.565113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.567462 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.567439    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-80952f-openshift-default-dockercfg-8psrs\""
Jul 30 23:25:05.577796 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.577763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:25:05.687798 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.687798 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl7ft\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.687991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.688282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.688070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.788990 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.788948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7ft\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789495 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789495 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789495 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789712 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789772 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789732    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789889 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.789963 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.789945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.792195 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.792170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.792505 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.792484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.797530 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.797509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7ft\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.797530 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.797525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token\") pod \"e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") " pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:05.876655 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:05.876570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:06.019474 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.019442    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:25:06.025312 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.025268    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:06.025426 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.025351    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:06.025426 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.025386    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:06.210577 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.210479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerStarted","Data":"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"}
Jul 30 23:25:06.210577 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.210540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerStarted","Data":"17c7a974e35ff39c2e8ddd3508cf8ce69bd263da0b227ea3cf72f0a24b2ee71c"}
Jul 30 23:25:06.233153 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.233090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podStartSLOduration=1.233070358 podStartE2EDuration="1.233070358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:25:06.231347667 +0000 UTC m=+2687.496593604" watchObservedRunningTime="2026-07-30 23:25:06.233070358 +0000 UTC m=+2687.498316321"
Jul 30 23:25:06.877475 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:06.877427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:07.882307 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:07.882269    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:08.223631 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:08.223543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:08.224515 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:08.224494    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:09.853196 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.853170    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:25:09.930181 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930085    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930351 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930351 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930217    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930351 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930351 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930351 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930332    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930619 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930372    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8f4l\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930619 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930410    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:09.930619 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930424    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930619 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930482    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket\") pod \"3891225e-6852-4434-8834-3d5bd96f311c\" (UID: \"3891225e-6852-4434-8834-3d5bd96f311c\") "
Jul 30 23:25:09.930825 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:09.930886 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930861    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:09.930886 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930880    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:09.930988 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.930965    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:25:09.931135 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.931084    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:09.931359 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.931323    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:09.933527 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.933501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:25:09.933913 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.933877    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:25:09.934034 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.934013    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l" (OuterVolumeSpecName: "kube-api-access-n8f4l") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "kube-api-access-n8f4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:25:09.934123 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:09.934086    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3891225e-6852-4434-8834-3d5bd96f311c" (UID: "3891225e-6852-4434-8834-3d5bd96f311c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:10.031449 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031416    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3891225e-6852-4434-8834-3d5bd96f311c-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031449 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031436    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031449 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031449    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3891225e-6852-4434-8834-3d5bd96f311c-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031462    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031472    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031484    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8f4l\" (UniqueName: \"kubernetes.io/projected/3891225e-6852-4434-8834-3d5bd96f311c-kube-api-access-n8f4l\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.031730 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.031498    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3891225e-6852-4434-8834-3d5bd96f311c-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:25:10.237785 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.237748    2559 generic.go:356] "Generic (PLEG): container finished" podID="3891225e-6852-4434-8834-3d5bd96f311c" containerID="2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3" exitCode=0
Jul 30 23:25:10.237961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.237805    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"
Jul 30 23:25:10.237961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.237833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerDied","Data":"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"}
Jul 30 23:25:10.237961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.237886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn" event={"ID":"3891225e-6852-4434-8834-3d5bd96f311c","Type":"ContainerDied","Data":"d2ed318b1ca1b63b63788183a951bbde9537a884cf1efe1c9365e702107e4272"}
Jul 30 23:25:10.237961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.237908    2559 scope.go:117] "RemoveContainer" containerID="2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"
Jul 30 23:25:10.248980 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.248960    2559 scope.go:117] "RemoveContainer" containerID="2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"
Jul 30 23:25:10.258505 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.258474    2559 scope.go:117] "RemoveContainer" containerID="2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"
Jul 30 23:25:10.258877 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:25:10.258854    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3\": container with ID starting with 2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3 not found: ID does not exist" containerID="2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"
Jul 30 23:25:10.258972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.258886    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3"} err="failed to get container status \"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3\": rpc error: code = NotFound desc = could not find container \"2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3\": container with ID starting with 2ec81c1a38ab40389b68a072dcbb4a979d83f613fc095facb2b0dcca3a7c44e3 not found: ID does not exist"
Jul 30 23:25:10.258972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.258905    2559 scope.go:117] "RemoveContainer" containerID="2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"
Jul 30 23:25:10.259224 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:25:10.259192    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2\": container with ID starting with 2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2 not found: ID does not exist" containerID="2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"
Jul 30 23:25:10.259303 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.259235    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2"} err="failed to get container status \"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2\": rpc error: code = NotFound desc = could not find container \"2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2\": container with ID starting with 2ad7b37c77d854428ed8f2c8db715dc3c22ddaa0651a3f56210b46e66ca146b2 not found: ID does not exist"
Jul 30 23:25:10.261068 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.261046    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:25:10.265387 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:10.265363    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1ed561-openshift-default-56598c8ff4-wmwgn"]
Jul 30 23:25:11.240464 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:11.240432    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3891225e-6852-4434-8834-3d5bd96f311c" path="/var/lib/kubelet/pods/3891225e-6852-4434-8834-3d5bd96f311c/volumes"
Jul 30 23:25:11.308293 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:11.308259    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:25:21.300731 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.300645    2559 generic.go:356] "Generic (PLEG): container finished" podID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerID="e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90" exitCode=0
Jul 30 23:25:21.301164 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.300717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerDied","Data":"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"}
Jul 30 23:25:21.301220 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.301161    2559 scope.go:117] "RemoveContainer" containerID="e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"
Jul 30 23:25:21.302154 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.302126    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:21.302224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.302194    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:21.302259 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:21.302225    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:22.307531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:22.307487    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerStarted","Data":"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"}
Jul 30 23:25:22.877655 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:22.877614    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:22.878811 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:22.878780    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:25:22.878928 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:22.878842    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:25:23.224260 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:23.224159    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:23.877035 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:23.876991    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:25:23.877457 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:23.877050    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:25:24.877579 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:24.877540    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:25:24.877963 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:24.877600    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:25:25.877249 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:25.877212    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:25:25.877438 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:25.877274    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:25:26.877665 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:26.877627    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:25:26.878074 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:26.877685    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:25:27.881481 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:27.881448    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:27.882426 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:27.882404    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:25:33.882015 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.881979    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:25:33.882563 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882544    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:25:33.882632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882566    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:25:33.882632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882592    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:33.882632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882597    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6bcef8-f00b-480a-b2f4-4b2232862bdd" containerName="istio-proxy"
Jul 30 23:25:33.882773 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882693    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:25:33.882773 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.882703    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:25:33.886119 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.886076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:33.888663 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.888640    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bb1098-openshift-default-dockercfg-6q9zn\""
Jul 30 23:25:33.896550 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:33.896523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:25:34.065109 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065347 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065347 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065347 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbf6d\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.065497 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.065489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.166972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.166872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.166972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.166920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.166972 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.166936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbf6d\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167576 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167576 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167733 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.167805 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.168013 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.167996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.169442 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.169423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.169661 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.169643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.177000 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.176972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.177141 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.177122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbf6d\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d\") pod \"e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") " pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.197042 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.197006    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:34.343686 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.343656    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:25:34.345426 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:25:34.345396    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc0cf69_b51d_4fc6_a814_ebe15c73cfbf.slice/crio-a33020fba89fc13968fd031b66f2c3c959d12d2f93870df0558be555e8ee8dba WatchSource:0}: Error finding container a33020fba89fc13968fd031b66f2c3c959d12d2f93870df0558be555e8ee8dba: Status 404 returned error can't find the container with id a33020fba89fc13968fd031b66f2c3c959d12d2f93870df0558be555e8ee8dba
Jul 30 23:25:34.347756 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.347724    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:34.347824 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.347793    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:34.347824 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.347819    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:34.387435 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:34.387403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerStarted","Data":"a33020fba89fc13968fd031b66f2c3c959d12d2f93870df0558be555e8ee8dba"}
Jul 30 23:25:35.395505 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:35.395466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerStarted","Data":"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"}
Jul 30 23:25:35.416262 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:35.416206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podStartSLOduration=2.416186068 podStartE2EDuration="2.416186068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:25:35.414827967 +0000 UTC m=+2716.680073904" watchObservedRunningTime="2026-07-30 23:25:35.416186068 +0000 UTC m=+2716.681432008"
Jul 30 23:25:36.198112 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:36.198063    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:36.203653 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:36.203621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:36.401768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:36.401739    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:36.402855 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:36.402837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:41.495552 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:41.495514    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:25:51.403420 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.403377    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:51.403850 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.403439    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:51.494118 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.494068    2559 generic.go:356] "Generic (PLEG): container finished" podID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerID="8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1" exitCode=0
Jul 30 23:25:51.494301 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.494146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerDied","Data":"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"}
Jul 30 23:25:51.494589 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.494570    2559 scope.go:117] "RemoveContainer" containerID="8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"
Jul 30 23:25:51.495574 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.495546    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:51.495630 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.495620    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:51.495668 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:51.495652    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:25:52.501983 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:52.501947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerStarted","Data":"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"}
Jul 30 23:25:53.197692 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:53.197653    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:53.197908 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:53.197884    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:53.197978 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:53.197944    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:54.197592 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:54.197547    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:54.198007 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:54.197607    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:55.198336 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:55.198295    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:55.198765 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:55.198353    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:56.197470 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:56.197424    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:56.197683 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:56.197510    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:57.197804 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:57.197766    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 23:25:57.198289 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:57.197823    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 23:25:58.201629 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:58.201599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:58.202074 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:58.201976    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:25:58.202780 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:25:58.202762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:26:24.095495 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:26:24.095454    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:26:41.049640 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:26:41.049597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:27:13.010310 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:27:13.010273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:27:39.199862 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:27:39.199825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:27:47.398845 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:27:47.398807    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:27:56.304837 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:27:56.304798    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:28:06.603178 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:28:06.603142    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:28:14.498724 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:28:14.498641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:28:23.604412 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:28:23.604376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:28:33.797087 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:28:33.797048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:28:45.398293 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:28:45.398252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:00.011891 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:00.011851    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:08.394408 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:08.394370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:17.400389 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:17.400355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:19.673071 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:19.673036    2559 scope.go:117] "RemoveContainer" containerID="f60306653adc3217985cf7077f575a7a0013ec9728360204e8272347883930fb"
Jul 30 23:29:32.000548 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:32.000511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:43.811602 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:43.811384    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:29:58.593692 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:29:58.593652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:30:00.149771 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.149732    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"]
Jul 30 23:30:00.150285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.150160    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:30:00.150285 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.150174    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3891225e-6852-4434-8834-3d5bd96f311c" containerName="istio-proxy"
Jul 30 23:30:00.153277 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.153257    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"]
Jul 30 23:30:00.153414 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.153388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"
Jul 30 23:30:00.156461 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.156443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"
Jul 30 23:30:00.158281 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.158263    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jqcdc\""
Jul 30 23:30:00.164060 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.164043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"
Jul 30 23:30:00.169997 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.169976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"
Jul 30 23:30:00.176234 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.176209    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"]
Jul 30 23:30:00.180865 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.180838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"]
Jul 30 23:30:00.326342 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.326304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"]
Jul 30 23:30:00.328719 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:30:00.328685    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044bb921_9e65_4f7b_aba7_4efeb68355a3.slice/crio-21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec WatchSource:0}: Error finding container 21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec: Status 404 returned error can't find the container with id 21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec
Jul 30 23:30:00.350156 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.350132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"]
Jul 30 23:30:00.352536 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:30:00.352486    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f8f15f_5792_43db_aeca_4fa2b1d5c429.slice/crio-93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90 WatchSource:0}: Error finding container 93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90: Status 404 returned error can't find the container with id 93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90
Jul 30 23:30:00.910465 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.910352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g" event={"ID":"c1f8f15f-5792-43db-aeca-4fa2b1d5c429","Type":"ContainerStarted","Data":"e5057cba73301d7efcdd8f1760fbf2ff29264d455979e2f45bc541fa9e99095c"}
Jul 30 23:30:00.910465 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.910421    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g" event={"ID":"c1f8f15f-5792-43db-aeca-4fa2b1d5c429","Type":"ContainerStarted","Data":"93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90"}
Jul 30 23:30:00.911901 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.911876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp" event={"ID":"044bb921-9e65-4f7b-aba7-4efeb68355a3","Type":"ContainerStarted","Data":"286453426b658e50d3b984d4d8b449df980f5da2a651087d3dca9f48ef7bf17f"}
Jul 30 23:30:00.912005 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.911915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp" event={"ID":"044bb921-9e65-4f7b-aba7-4efeb68355a3","Type":"ContainerStarted","Data":"21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec"}
Jul 30 23:30:00.927768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.927717    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g" podStartSLOduration=0.927698063 podStartE2EDuration="927.698063ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:00.925879152 +0000 UTC m=+2982.191125091" watchObservedRunningTime="2026-07-30 23:30:00.927698063 +0000 UTC m=+2982.192943999"
Jul 30 23:30:00.940789 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:00.940625    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp" podStartSLOduration=0.940606554 podStartE2EDuration="940.606554ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:00.939974069 +0000 UTC m=+2982.205220005" watchObservedRunningTime="2026-07-30 23:30:00.940606554 +0000 UTC m=+2982.205852492"
Jul 30 23:30:01.919321 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:01.919285    2559 generic.go:356] "Generic (PLEG): container finished" podID="044bb921-9e65-4f7b-aba7-4efeb68355a3" containerID="286453426b658e50d3b984d4d8b449df980f5da2a651087d3dca9f48ef7bf17f" exitCode=0
Jul 30 23:30:01.919767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:01.919365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp" event={"ID":"044bb921-9e65-4f7b-aba7-4efeb68355a3","Type":"ContainerDied","Data":"286453426b658e50d3b984d4d8b449df980f5da2a651087d3dca9f48ef7bf17f"}
Jul 30 23:30:01.928220 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:01.928186    2559 generic.go:356] "Generic (PLEG): container finished" podID="c1f8f15f-5792-43db-aeca-4fa2b1d5c429" containerID="e5057cba73301d7efcdd8f1760fbf2ff29264d455979e2f45bc541fa9e99095c" exitCode=0
Jul 30 23:30:01.928375 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:01.928241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g" event={"ID":"c1f8f15f-5792-43db-aeca-4fa2b1d5c429","Type":"ContainerDied","Data":"e5057cba73301d7efcdd8f1760fbf2ff29264d455979e2f45bc541fa9e99095c"}
Jul 30 23:30:03.061279 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.061253    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"
Jul 30 23:30:03.108981 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.108954    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"
Jul 30 23:30:03.941255 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.941223    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"
Jul 30 23:30:03.941437 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.941227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g" event={"ID":"c1f8f15f-5792-43db-aeca-4fa2b1d5c429","Type":"ContainerDied","Data":"93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90"}
Jul 30 23:30:03.941437 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.941361    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93066ecf0ebbad5f048e15ed756c7ccea7b863b83d4d5be2f6caea25b6071a90"
Jul 30 23:30:03.942574 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.942551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"
Jul 30 23:30:03.942683 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.942551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp" event={"ID":"044bb921-9e65-4f7b-aba7-4efeb68355a3","Type":"ContainerDied","Data":"21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec"}
Jul 30 23:30:03.942683 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:03.942671    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21c9fd0b4aa6faebdc22dbd317937565b10a509f3de4b5c0ebc29d7f8ed070ec"
Jul 30 23:30:08.998443 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:08.998407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:30:17.197930 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:17.197896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:30:40.509461 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:30:40.509424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:31:19.704294 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:31:19.704257    2559 scope.go:117] "RemoveContainer" containerID="76c4c50e4e93f4142133dd297e26ec1111a8e2c552ecd3fc4e405f864e806491"
Jul 30 23:31:26.592854 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:31:26.592820    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:31:39.301489 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:31:39.301445    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:31:50.794166 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:31:50.794120    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:32:01.196701 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:01.196663    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:32:07.704120 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704060    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:32:07.704659 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704637    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044bb921-9e65-4f7b-aba7-4efeb68355a3" containerName="cleanup"
Jul 30 23:32:07.704744 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704661    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="044bb921-9e65-4f7b-aba7-4efeb68355a3" containerName="cleanup"
Jul 30 23:32:07.704744 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704711    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f8f15f-5792-43db-aeca-4fa2b1d5c429" containerName="cleanup"
Jul 30 23:32:07.704744 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704720    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f8f15f-5792-43db-aeca-4fa2b1d5c429" containerName="cleanup"
Jul 30 23:32:07.704891 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704841    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1f8f15f-5792-43db-aeca-4fa2b1d5c429" containerName="cleanup"
Jul 30 23:32:07.704891 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.704852    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="044bb921-9e65-4f7b-aba7-4efeb68355a3" containerName="cleanup"
Jul 30 23:32:07.707855 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.707835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.710605 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.710581    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-80952f\"/\"openshift-service-ca.crt\""
Jul 30 23:32:07.710729 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.710619    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-80952f\"/\"kube-root-ca.crt\""
Jul 30 23:32:07.711747 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.711727    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-80952f\"/\"default-dockercfg-f7kkp\""
Jul 30 23:32:07.711747 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.711741    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-80952f\"/\"rate-test-model-80952f-kserve-self-signed-certs\""
Jul 30 23:32:07.716420 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.716402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:32:07.858079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4gwq\" (UniqueName: \"kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.858079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.858356 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.858356 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.858356 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.858356 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.858304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959526 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959526 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4gwq\" (UniqueName: \"kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959768 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.959931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.960018 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.959997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.960143 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.960122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.962022 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.961992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.962171 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.962155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:07.967447 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:07.967420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4gwq\" (UniqueName: \"kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq\") pod \"rate-test-model-80952f-kserve-74f4ccd755-zrxx8\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") " pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:08.018290 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:08.018253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:08.159590 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:08.159560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:32:08.161329 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:32:08.161297    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb256c634_0fe6_439d_914c_76ee9888ff98.slice/crio-5211500cf27575885b791cd86dd1d9d5c883e7e1b358a870e288b20ebedf676c WatchSource:0}: Error finding container 5211500cf27575885b791cd86dd1d9d5c883e7e1b358a870e288b20ebedf676c: Status 404 returned error can't find the container with id 5211500cf27575885b791cd86dd1d9d5c883e7e1b358a870e288b20ebedf676c
Jul 30 23:32:08.163214 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:08.163196    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:32:08.657618 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:08.657579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" event={"ID":"b256c634-0fe6-439d-914c-76ee9888ff98","Type":"ContainerStarted","Data":"5211500cf27575885b791cd86dd1d9d5c883e7e1b358a870e288b20ebedf676c"}
Jul 30 23:32:09.665405 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:09.665368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" event={"ID":"b256c634-0fe6-439d-914c-76ee9888ff98","Type":"ContainerStarted","Data":"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"}
Jul 30 23:32:09.681496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:09.681444    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" podStartSLOduration=1.622255903 podStartE2EDuration="2.681428802s" totalImagesPullingTime="1.059172899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:32:09.680186071 +0000 UTC m=+3110.945432011" watchObservedRunningTime="2026-07-30 23:32:09.681428802 +0000 UTC m=+3110.946674738"
Jul 30 23:32:10.189051 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:10.189019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:32:18.018767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:18.018721    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:18.018767 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:18.018777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:18.031555 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:18.031526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:18.727469 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:18.727432    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:32:53.493877 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:32:53.493836    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:33:28.599521 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:33:28.599486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:33:37.503776 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:33:37.503743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:33:53.303021 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:33:53.302983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:33:58.712942 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:33:58.712910    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:34:00.520208 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.520171    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580418736"]
Jul 30 23:34:00.523633 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.523616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:00.526191 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.526169    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2g7h2\""
Jul 30 23:34:00.531305 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.530899    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580418736"]
Jul 30 23:34:00.560708 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.560676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86x7\" (UniqueName: \"kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7\") pod \"test-curl-7692-139992580418736\" (UID: \"439f3137-6847-4da2-a8ca-3b5025188d58\") " pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:00.661213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.661176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86x7\" (UniqueName: \"kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7\") pod \"test-curl-7692-139992580418736\" (UID: \"439f3137-6847-4da2-a8ca-3b5025188d58\") " pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:00.669177 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.669150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86x7\" (UniqueName: \"kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7\") pod \"test-curl-7692-139992580418736\" (UID: \"439f3137-6847-4da2-a8ca-3b5025188d58\") " pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:00.835134 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.835011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:00.966547 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:00.966518    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580418736"]
Jul 30 23:34:00.967275 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:00.967248    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod439f3137_6847_4da2_a8ca_3b5025188d58.slice/crio-6b79df8c4f736e18c9519852e6602e42363dcd8aac2f2fc00b05ca78ce1d3e00 WatchSource:0}: Error finding container 6b79df8c4f736e18c9519852e6602e42363dcd8aac2f2fc00b05ca78ce1d3e00: Status 404 returned error can't find the container with id 6b79df8c4f736e18c9519852e6602e42363dcd8aac2f2fc00b05ca78ce1d3e00
Jul 30 23:34:01.301462 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:01.301424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580418736" event={"ID":"439f3137-6847-4da2-a8ca-3b5025188d58","Type":"ContainerStarted","Data":"6b79df8c4f736e18c9519852e6602e42363dcd8aac2f2fc00b05ca78ce1d3e00"}
Jul 30 23:34:01.496224 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:01.496190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:34:02.316180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:02.316146    2559 generic.go:356] "Generic (PLEG): container finished" podID="439f3137-6847-4da2-a8ca-3b5025188d58" containerID="70656d8221f5194d267cf471f754a8c5f4f108d3dfd21a99a103059d02cefcdc" exitCode=0
Jul 30 23:34:02.316582 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:02.316230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580418736" event={"ID":"439f3137-6847-4da2-a8ca-3b5025188d58","Type":"ContainerDied","Data":"70656d8221f5194d267cf471f754a8c5f4f108d3dfd21a99a103059d02cefcdc"}
Jul 30 23:34:03.453444 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.453420    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:03.486458 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.486428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r86x7\" (UniqueName: \"kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7\") pod \"439f3137-6847-4da2-a8ca-3b5025188d58\" (UID: \"439f3137-6847-4da2-a8ca-3b5025188d58\") "
Jul 30 23:34:03.488770 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.488745    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7" (OuterVolumeSpecName: "kube-api-access-r86x7") pod "439f3137-6847-4da2-a8ca-3b5025188d58" (UID: "439f3137-6847-4da2-a8ca-3b5025188d58"). InnerVolumeSpecName "kube-api-access-r86x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:03.488930 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.488871    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580418736_439f3137-6847-4da2-a8ca-3b5025188d58/test-curl-7692-139992580418736/0.log"
Jul 30 23:34:03.513216 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.513186    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580418736"]
Jul 30 23:34:03.515451 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.515432    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580418736"]
Jul 30 23:34:03.587775 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.587706    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r86x7\" (UniqueName: \"kubernetes.io/projected/439f3137-6847-4da2-a8ca-3b5025188d58-kube-api-access-r86x7\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:03.639616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.639582    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580417328"]
Jul 30 23:34:03.640006 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.639988    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3137-6847-4da2-a8ca-3b5025188d58" containerName="test-curl-7692-139992580418736"
Jul 30 23:34:03.640076 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.640008    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3137-6847-4da2-a8ca-3b5025188d58" containerName="test-curl-7692-139992580418736"
Jul 30 23:34:03.640171 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.640160    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="439f3137-6847-4da2-a8ca-3b5025188d58" containerName="test-curl-7692-139992580418736"
Jul 30 23:34:03.643314 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.643296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:03.648732 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.648701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580417328"]
Jul 30 23:34:03.688787 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.688765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzvwx\" (UniqueName: \"kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx\") pod \"test-curl-7692-139992580417328\" (UID: \"40b08309-c5e1-4e15-ae9b-c625742fef7a\") " pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:03.790173 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.790147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzvwx\" (UniqueName: \"kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx\") pod \"test-curl-7692-139992580417328\" (UID: \"40b08309-c5e1-4e15-ae9b-c625742fef7a\") " pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:03.798518 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.798495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzvwx\" (UniqueName: \"kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx\") pod \"test-curl-7692-139992580417328\" (UID: \"40b08309-c5e1-4e15-ae9b-c625742fef7a\") " pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:03.953742 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:03.953662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:04.085200 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:04.085170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580417328"]
Jul 30 23:34:04.086675 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:04.086652    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40b08309_c5e1_4e15_ae9b_c625742fef7a.slice/crio-26fa6e68da817ef01a9b20f088b2d1aae8e10ef2d595dfd9747ffa29b47ffcb4 WatchSource:0}: Error finding container 26fa6e68da817ef01a9b20f088b2d1aae8e10ef2d595dfd9747ffa29b47ffcb4: Status 404 returned error can't find the container with id 26fa6e68da817ef01a9b20f088b2d1aae8e10ef2d595dfd9747ffa29b47ffcb4
Jul 30 23:34:04.330373 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:04.330345    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:04.330552 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:04.330396    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b79df8c4f736e18c9519852e6602e42363dcd8aac2f2fc00b05ca78ce1d3e00"
Jul 30 23:34:04.331481 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:04.331455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580417328" event={"ID":"40b08309-c5e1-4e15-ae9b-c625742fef7a","Type":"ContainerStarted","Data":"26fa6e68da817ef01a9b20f088b2d1aae8e10ef2d595dfd9747ffa29b47ffcb4"}
Jul 30 23:34:04.340557 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:34:04.340531    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7692-139992580418736\" is forbidden: User \"system:node:ip-10-0-143-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-234.ec2.internal' and this object" podUID="439f3137-6847-4da2-a8ca-3b5025188d58" pod="opendatahub/test-curl-7692-139992580418736"
Jul 30 23:34:05.241274 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:05.241246    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="439f3137-6847-4da2-a8ca-3b5025188d58" path="/var/lib/kubelet/pods/439f3137-6847-4da2-a8ca-3b5025188d58/volumes"
Jul 30 23:34:05.338632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:05.338602    2559 generic.go:356] "Generic (PLEG): container finished" podID="40b08309-c5e1-4e15-ae9b-c625742fef7a" containerID="b57390300d213097a26c8086f8ed6f053aabaffad5602dfcae6c2fa596b993ea" exitCode=0
Jul 30 23:34:05.338780 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:05.338680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580417328" event={"ID":"40b08309-c5e1-4e15-ae9b-c625742fef7a","Type":"ContainerDied","Data":"b57390300d213097a26c8086f8ed6f053aabaffad5602dfcae6c2fa596b993ea"}
Jul 30 23:34:06.477838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.477818    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:06.497903 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.497858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580417328_40b08309-c5e1-4e15-ae9b-c625742fef7a/test-curl-7692-139992580417328/0.log"
Jul 30 23:34:06.524538 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.524512    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580417328"]
Jul 30 23:34:06.527937 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.527915    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580417328"]
Jul 30 23:34:06.616365 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.616308    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzvwx\" (UniqueName: \"kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx\") pod \"40b08309-c5e1-4e15-ae9b-c625742fef7a\" (UID: \"40b08309-c5e1-4e15-ae9b-c625742fef7a\") "
Jul 30 23:34:06.618409 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.618386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx" (OuterVolumeSpecName: "kube-api-access-dzvwx") pod "40b08309-c5e1-4e15-ae9b-c625742fef7a" (UID: "40b08309-c5e1-4e15-ae9b-c625742fef7a"). InnerVolumeSpecName "kube-api-access-dzvwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:06.714417 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.714387    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:06.714806 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.714793    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b08309-c5e1-4e15-ae9b-c625742fef7a" containerName="test-curl-7692-139992580417328"
Jul 30 23:34:06.714855 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.714809    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b08309-c5e1-4e15-ae9b-c625742fef7a" containerName="test-curl-7692-139992580417328"
Jul 30 23:34:06.714890 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.714872    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b08309-c5e1-4e15-ae9b-c625742fef7a" containerName="test-curl-7692-139992580417328"
Jul 30 23:34:06.717364 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.717339    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzvwx\" (UniqueName: \"kubernetes.io/projected/40b08309-c5e1-4e15-ae9b-c625742fef7a-kube-api-access-dzvwx\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:06.717864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.717849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:06.725330 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.724930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:06.818283 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.818256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79xg8\" (UniqueName: \"kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8\") pod \"test-curl-7692-139992580500624\" (UID: \"1ac343dc-24cd-4364-809b-6371e9c46f73\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:06.918824 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.918762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79xg8\" (UniqueName: \"kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8\") pod \"test-curl-7692-139992580500624\" (UID: \"1ac343dc-24cd-4364-809b-6371e9c46f73\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:06.926735 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:06.926711    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79xg8\" (UniqueName: \"kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8\") pod \"test-curl-7692-139992580500624\" (UID: \"1ac343dc-24cd-4364-809b-6371e9c46f73\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:07.028029 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.027993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:07.158520 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.158490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:07.159672 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:07.159646    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ac343dc_24cd_4364_809b_6371e9c46f73.slice/crio-849bc20027a6a1cf01629e144908f44a9488d01f585610ff0908c0644928885c WatchSource:0}: Error finding container 849bc20027a6a1cf01629e144908f44a9488d01f585610ff0908c0644928885c: Status 404 returned error can't find the container with id 849bc20027a6a1cf01629e144908f44a9488d01f585610ff0908c0644928885c
Jul 30 23:34:07.240295 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.240268    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b08309-c5e1-4e15-ae9b-c625742fef7a" path="/var/lib/kubelet/pods/40b08309-c5e1-4e15-ae9b-c625742fef7a/volumes"
Jul 30 23:34:07.351456 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.351421    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580500624" event={"ID":"1ac343dc-24cd-4364-809b-6371e9c46f73","Type":"ContainerStarted","Data":"849bc20027a6a1cf01629e144908f44a9488d01f585610ff0908c0644928885c"}
Jul 30 23:34:07.352616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.352595    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580417328"
Jul 30 23:34:07.352707 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:07.352622    2559 scope.go:117] "RemoveContainer" containerID="b57390300d213097a26c8086f8ed6f053aabaffad5602dfcae6c2fa596b993ea"
Jul 30 23:34:08.359179 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:08.359142    2559 generic.go:356] "Generic (PLEG): container finished" podID="1ac343dc-24cd-4364-809b-6371e9c46f73" containerID="9b589b79de5849d676b55bd6bac05fb3762f23a2e8d5818cae139477ee04bb13" exitCode=0
Jul 30 23:34:08.359598 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:08.359225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580500624" event={"ID":"1ac343dc-24cd-4364-809b-6371e9c46f73","Type":"ContainerDied","Data":"9b589b79de5849d676b55bd6bac05fb3762f23a2e8d5818cae139477ee04bb13"}
Jul 30 23:34:09.499213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.499189    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:09.518719 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.518680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580500624_1ac343dc-24cd-4364-809b-6371e9c46f73/test-curl-7692-139992580500624/0.log"
Jul 30 23:34:09.545079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.545051    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:09.548910 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.548887    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:09.642082 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.641999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79xg8\" (UniqueName: \"kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8\") pod \"1ac343dc-24cd-4364-809b-6371e9c46f73\" (UID: \"1ac343dc-24cd-4364-809b-6371e9c46f73\") "
Jul 30 23:34:09.644021 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.643997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8" (OuterVolumeSpecName: "kube-api-access-79xg8") pod "1ac343dc-24cd-4364-809b-6371e9c46f73" (UID: "1ac343dc-24cd-4364-809b-6371e9c46f73"). InnerVolumeSpecName "kube-api-access-79xg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:09.682234 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.682209    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:09.682609 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.682595    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac343dc-24cd-4364-809b-6371e9c46f73" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:09.682658 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.682611    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac343dc-24cd-4364-809b-6371e9c46f73" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:09.682705 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.682670    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac343dc-24cd-4364-809b-6371e9c46f73" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:09.685634 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.685619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:09.690087 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.690054    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:09.743186 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.743153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9bh2\" (UniqueName: \"kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2\") pod \"test-curl-7692-139992580500624\" (UID: \"62d49ab1-012e-4a88-b751-0eac982ac09a\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:09.743335 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.743318    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79xg8\" (UniqueName: \"kubernetes.io/projected/1ac343dc-24cd-4364-809b-6371e9c46f73-kube-api-access-79xg8\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:09.844673 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.844643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9bh2\" (UniqueName: \"kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2\") pod \"test-curl-7692-139992580500624\" (UID: \"62d49ab1-012e-4a88-b751-0eac982ac09a\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:09.855561 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.855532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9bh2\" (UniqueName: \"kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2\") pod \"test-curl-7692-139992580500624\" (UID: \"62d49ab1-012e-4a88-b751-0eac982ac09a\") " pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:09.996177 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:09.996153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:10.126865 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:10.126834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:10.128183 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:10.128154    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62d49ab1_012e_4a88_b751_0eac982ac09a.slice/crio-35bd7267fab822d72a3eecde17d1d89c39d015ab87a58781ce3542ce4b10c658 WatchSource:0}: Error finding container 35bd7267fab822d72a3eecde17d1d89c39d015ab87a58781ce3542ce4b10c658: Status 404 returned error can't find the container with id 35bd7267fab822d72a3eecde17d1d89c39d015ab87a58781ce3542ce4b10c658
Jul 30 23:34:10.373418 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:10.373340    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:10.373418 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:10.373380    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="849bc20027a6a1cf01629e144908f44a9488d01f585610ff0908c0644928885c"
Jul 30 23:34:10.374487 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:10.374459    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580500624" event={"ID":"62d49ab1-012e-4a88-b751-0eac982ac09a","Type":"ContainerStarted","Data":"35bd7267fab822d72a3eecde17d1d89c39d015ab87a58781ce3542ce4b10c658"}
Jul 30 23:34:10.384335 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:10.384310    2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7692-139992580500624" oldPodUID="1ac343dc-24cd-4364-809b-6371e9c46f73" podUID="62d49ab1-012e-4a88-b751-0eac982ac09a"
Jul 30 23:34:11.240886 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:11.240853    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac343dc-24cd-4364-809b-6371e9c46f73" path="/var/lib/kubelet/pods/1ac343dc-24cd-4364-809b-6371e9c46f73/volumes"
Jul 30 23:34:11.382009 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:11.381981    2559 generic.go:356] "Generic (PLEG): container finished" podID="62d49ab1-012e-4a88-b751-0eac982ac09a" containerID="d0ae700f6b9bcb96f04dd45890123962e62f157e579855e56bdbd9688a854e81" exitCode=0
Jul 30 23:34:11.382187 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:11.382078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580500624" event={"ID":"62d49ab1-012e-4a88-b751-0eac982ac09a","Type":"ContainerDied","Data":"d0ae700f6b9bcb96f04dd45890123962e62f157e579855e56bdbd9688a854e81"}
Jul 30 23:34:12.518793 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.518767    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:12.540054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.540031    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580500624_62d49ab1-012e-4a88-b751-0eac982ac09a/test-curl-7692-139992580500624/0.log"
Jul 30 23:34:12.567517 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.567226    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:12.570136 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.570117    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580500624"]
Jul 30 23:34:12.668540 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.668466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9bh2\" (UniqueName: \"kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2\") pod \"62d49ab1-012e-4a88-b751-0eac982ac09a\" (UID: \"62d49ab1-012e-4a88-b751-0eac982ac09a\") "
Jul 30 23:34:12.670559 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.670530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2" (OuterVolumeSpecName: "kube-api-access-v9bh2") pod "62d49ab1-012e-4a88-b751-0eac982ac09a" (UID: "62d49ab1-012e-4a88-b751-0eac982ac09a"). InnerVolumeSpecName "kube-api-access-v9bh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:12.696808 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.696783    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:12.697173 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.697160    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d49ab1-012e-4a88-b751-0eac982ac09a" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:12.697225 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.697174    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d49ab1-012e-4a88-b751-0eac982ac09a" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:12.697261 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.697251    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d49ab1-012e-4a88-b751-0eac982ac09a" containerName="test-curl-7692-139992580500624"
Jul 30 23:34:12.700198 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.700179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:12.707115 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.707032    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:12.769931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.769908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhhdj\" (UniqueName: \"kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj\") pod \"test-curl-7692-139992580509744\" (UID: \"90a7eedb-eff6-4211-bfec-3a0113f7df7e\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:12.770046 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.770034    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9bh2\" (UniqueName: \"kubernetes.io/projected/62d49ab1-012e-4a88-b751-0eac982ac09a-kube-api-access-v9bh2\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:12.871180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.871157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhhdj\" (UniqueName: \"kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj\") pod \"test-curl-7692-139992580509744\" (UID: \"90a7eedb-eff6-4211-bfec-3a0113f7df7e\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:12.879082 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:12.879061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhhdj\" (UniqueName: \"kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj\") pod \"test-curl-7692-139992580509744\" (UID: \"90a7eedb-eff6-4211-bfec-3a0113f7df7e\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:13.009907 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.009882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:13.138590 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.138560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:13.139668 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:13.139646    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90a7eedb_eff6_4211_bfec_3a0113f7df7e.slice/crio-5220831a49a0ca479b559c8a786d3160112cdc44b332445afb58a0100636e56a WatchSource:0}: Error finding container 5220831a49a0ca479b559c8a786d3160112cdc44b332445afb58a0100636e56a: Status 404 returned error can't find the container with id 5220831a49a0ca479b559c8a786d3160112cdc44b332445afb58a0100636e56a
Jul 30 23:34:13.240944 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.240902    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d49ab1-012e-4a88-b751-0eac982ac09a" path="/var/lib/kubelet/pods/62d49ab1-012e-4a88-b751-0eac982ac09a/volumes"
Jul 30 23:34:13.395315 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.395250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580509744" event={"ID":"90a7eedb-eff6-4211-bfec-3a0113f7df7e","Type":"ContainerStarted","Data":"5220831a49a0ca479b559c8a786d3160112cdc44b332445afb58a0100636e56a"}
Jul 30 23:34:13.396521 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.396502    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580500624"
Jul 30 23:34:13.396650 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.396505    2559 scope.go:117] "RemoveContainer" containerID="d0ae700f6b9bcb96f04dd45890123962e62f157e579855e56bdbd9688a854e81"
Jul 30 23:34:13.735805 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.735771    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" podUID="b256c634-0fe6-439d-914c-76ee9888ff98" containerName="main" containerID="cri-o://5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c" gracePeriod=45
Jul 30 23:34:13.989657 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:13.989600    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:34:14.083213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083213 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083226    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4gwq\" (UniqueName: \"kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083436 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083436 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083273    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083436 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083319    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083436 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083418    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:34:14.083656 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home\") pod \"b256c634-0fe6-439d-914c-76ee9888ff98\" (UID: \"b256c634-0fe6-439d-914c-76ee9888ff98\") "
Jul 30 23:34:14.083656 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache" (OuterVolumeSpecName: "model-cache") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:34:14.083765 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.083667    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home" (OuterVolumeSpecName: "home") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:34:14.084035 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.084015    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-tmp-dir\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.084090 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.084040    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-model-cache\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.084090 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.084053    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-home\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.085520 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.085497    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm" (OuterVolumeSpecName: "dshm") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:34:14.085678 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.085566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq" (OuterVolumeSpecName: "kube-api-access-g4gwq") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "kube-api-access-g4gwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:14.085678 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.085596    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b256c634-0fe6-439d-914c-76ee9888ff98" (UID: "b256c634-0fe6-439d-914c-76ee9888ff98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:34:14.185304 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.185281    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4gwq\" (UniqueName: \"kubernetes.io/projected/b256c634-0fe6-439d-914c-76ee9888ff98-kube-api-access-g4gwq\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.185304 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.185303    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b256c634-0fe6-439d-914c-76ee9888ff98-tls-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.185438 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.185312    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b256c634-0fe6-439d-914c-76ee9888ff98-dshm\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:14.403961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.403877    2559 generic.go:356] "Generic (PLEG): container finished" podID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" containerID="22769f1402fc85920d3a44e8565e8d7a7adfcbf24e3ed2372a749335a1a9716c" exitCode=0
Jul 30 23:34:14.404086 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.403950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580509744" event={"ID":"90a7eedb-eff6-4211-bfec-3a0113f7df7e","Type":"ContainerDied","Data":"22769f1402fc85920d3a44e8565e8d7a7adfcbf24e3ed2372a749335a1a9716c"}
Jul 30 23:34:14.405962 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.405940    2559 generic.go:356] "Generic (PLEG): container finished" podID="b256c634-0fe6-439d-914c-76ee9888ff98" containerID="5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c" exitCode=0
Jul 30 23:34:14.406078 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.405982    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"
Jul 30 23:34:14.406078 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.405997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" event={"ID":"b256c634-0fe6-439d-914c-76ee9888ff98","Type":"ContainerDied","Data":"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"}
Jul 30 23:34:14.406078 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.406022    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8" event={"ID":"b256c634-0fe6-439d-914c-76ee9888ff98","Type":"ContainerDied","Data":"5211500cf27575885b791cd86dd1d9d5c883e7e1b358a870e288b20ebedf676c"}
Jul 30 23:34:14.406078 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.406039    2559 scope.go:117] "RemoveContainer" containerID="5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"
Jul 30 23:34:14.415133 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.415116    2559 scope.go:117] "RemoveContainer" containerID="5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"
Jul 30 23:34:14.415411 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:34:14.415392    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c\": container with ID starting with 5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c not found: ID does not exist" containerID="5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"
Jul 30 23:34:14.415472 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.415419    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c"} err="failed to get container status \"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c\": rpc error: code = NotFound desc = could not find container \"5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c\": container with ID starting with 5a80490fb769824219c35a3036abde4d512f4621db97824278a879c704f17d0c not found: ID does not exist"
Jul 30 23:34:14.430647 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.430626    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:34:14.434225 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:14.434205    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-80952f/rate-test-model-80952f-kserve-74f4ccd755-zrxx8"]
Jul 30 23:34:15.241295 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.241264    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b256c634-0fe6-439d-914c-76ee9888ff98" path="/var/lib/kubelet/pods/b256c634-0fe6-439d-914c-76ee9888ff98/volumes"
Jul 30 23:34:15.545999 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.545977    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:15.566517 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.566482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580509744_90a7eedb-eff6-4211-bfec-3a0113f7df7e/test-curl-7692-139992580509744/0.log"
Jul 30 23:34:15.592230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.592204    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:15.595507 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.595486    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:15.699048 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.699025    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhhdj\" (UniqueName: \"kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj\") pod \"90a7eedb-eff6-4211-bfec-3a0113f7df7e\" (UID: \"90a7eedb-eff6-4211-bfec-3a0113f7df7e\") "
Jul 30 23:34:15.701205 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.701183    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj" (OuterVolumeSpecName: "kube-api-access-qhhdj") pod "90a7eedb-eff6-4211-bfec-3a0113f7df7e" (UID: "90a7eedb-eff6-4211-bfec-3a0113f7df7e"). InnerVolumeSpecName "kube-api-access-qhhdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:15.721624 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.721604    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:15.721970 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.721958    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b256c634-0fe6-439d-914c-76ee9888ff98" containerName="main"
Jul 30 23:34:15.722015 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.721971    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b256c634-0fe6-439d-914c-76ee9888ff98" containerName="main"
Jul 30 23:34:15.722015 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.721979    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:15.722015 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.721985    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:15.722124 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.722059    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b256c634-0fe6-439d-914c-76ee9888ff98" containerName="main"
Jul 30 23:34:15.722124 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.722067    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:15.725159 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.725145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:15.731633 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.731609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:15.800410 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.800349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nw7b\" (UniqueName: \"kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b\") pod \"test-curl-7692-139992580509744\" (UID: \"7bfbc317-fa5f-4e25-8e33-36e68eab0992\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:15.800503 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.800418    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhhdj\" (UniqueName: \"kubernetes.io/projected/90a7eedb-eff6-4211-bfec-3a0113f7df7e-kube-api-access-qhhdj\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:15.901157 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.901136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nw7b\" (UniqueName: \"kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b\") pod \"test-curl-7692-139992580509744\" (UID: \"7bfbc317-fa5f-4e25-8e33-36e68eab0992\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:15.909233 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:15.909216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nw7b\" (UniqueName: \"kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b\") pod \"test-curl-7692-139992580509744\" (UID: \"7bfbc317-fa5f-4e25-8e33-36e68eab0992\") " pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:16.034132 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.034093    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:16.162232 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.162208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:16.420336 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.420266    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:16.420336 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.420309    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5220831a49a0ca479b559c8a786d3160112cdc44b332445afb58a0100636e56a"
Jul 30 23:34:16.421637 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.421610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580509744" event={"ID":"7bfbc317-fa5f-4e25-8e33-36e68eab0992","Type":"ContainerStarted","Data":"b2ce205d57a4a06139bcd8ffd55e7adc001548976703e7a053a8be86d79e6c39"}
Jul 30 23:34:16.431291 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:16.431270    2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7692-139992580509744" oldPodUID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" podUID="7bfbc317-fa5f-4e25-8e33-36e68eab0992"
Jul 30 23:34:17.240091 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:17.240058    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a7eedb-eff6-4211-bfec-3a0113f7df7e" path="/var/lib/kubelet/pods/90a7eedb-eff6-4211-bfec-3a0113f7df7e/volumes"
Jul 30 23:34:17.428368 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:17.428334    2559 generic.go:356] "Generic (PLEG): container finished" podID="7bfbc317-fa5f-4e25-8e33-36e68eab0992" containerID="39c5d50c680b28bbd67540b3f0beb1c4e538638779deb30dcf5c1965eb1f92b1" exitCode=0
Jul 30 23:34:17.428719 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:17.428424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7692-139992580509744" event={"ID":"7bfbc317-fa5f-4e25-8e33-36e68eab0992","Type":"ContainerDied","Data":"39c5d50c680b28bbd67540b3f0beb1c4e538638779deb30dcf5c1965eb1f92b1"}
Jul 30 23:34:18.561046 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.561023    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:18.597510 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.597342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7692-139992580509744_7bfbc317-fa5f-4e25-8e33-36e68eab0992/test-curl-7692-139992580509744/0.log"
Jul 30 23:34:18.624812 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.624778    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:18.626994 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.626974    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7692-139992580509744"]
Jul 30 23:34:18.726393 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.726329    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nw7b\" (UniqueName: \"kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b\") pod \"7bfbc317-fa5f-4e25-8e33-36e68eab0992\" (UID: \"7bfbc317-fa5f-4e25-8e33-36e68eab0992\") "
Jul 30 23:34:18.728474 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.728446    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b" (OuterVolumeSpecName: "kube-api-access-6nw7b") pod "7bfbc317-fa5f-4e25-8e33-36e68eab0992" (UID: "7bfbc317-fa5f-4e25-8e33-36e68eab0992"). InnerVolumeSpecName "kube-api-access-6nw7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:34:18.827660 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:18.827628    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nw7b\" (UniqueName: \"kubernetes.io/projected/7bfbc317-fa5f-4e25-8e33-36e68eab0992-kube-api-access-6nw7b\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:34:19.240452 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.240412    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bfbc317-fa5f-4e25-8e33-36e68eab0992" path="/var/lib/kubelet/pods/7bfbc317-fa5f-4e25-8e33-36e68eab0992/volumes"
Jul 30 23:34:19.441712 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.441681    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7692-139992580509744"
Jul 30 23:34:19.441888 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.441740    2559 scope.go:117] "RemoveContainer" containerID="39c5d50c680b28bbd67540b3f0beb1c4e538638779deb30dcf5c1965eb1f92b1"
Jul 30 23:34:19.446514 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.446476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:34:19.447049 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.447027    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfbc317-fa5f-4e25-8e33-36e68eab0992" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:19.447049 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.447050    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfbc317-fa5f-4e25-8e33-36e68eab0992" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:19.447193 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.447143    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bfbc317-fa5f-4e25-8e33-36e68eab0992" containerName="test-curl-7692-139992580509744"
Jul 30 23:34:19.450696 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.450674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.453215 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.453194    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-287423-openshift-default-dockercfg-klvjv\""
Jul 30 23:34:19.462144 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.462123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:34:19.534408 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534549 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534549 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534549 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534714 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534865 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.534865 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.534765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9v8d\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636266 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9v8d\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.636669 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.637081 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.637081 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.637081 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.636906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.637223 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.637189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.638843 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.638824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.639054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.639038    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.644010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.643984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.644124 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.644045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9v8d\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d\") pod \"e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") " pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.762441 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.762418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:19.905999 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.905969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:34:19.908331 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:34:19.908305    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccee9a4_981a_497c_9c5b_52d6385431bf.slice/crio-2dad55634e1f08fd4ef4fe256a73a38cadf71d24a5f4ade0b77d82fc40f67e4b WatchSource:0}: Error finding container 2dad55634e1f08fd4ef4fe256a73a38cadf71d24a5f4ade0b77d82fc40f67e4b: Status 404 returned error can't find the container with id 2dad55634e1f08fd4ef4fe256a73a38cadf71d24a5f4ade0b77d82fc40f67e4b
Jul 30 23:34:19.911184 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.911146    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:19.911247 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.911231    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:19.911286 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:19.911272    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:20.448282 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:20.448245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerStarted","Data":"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"}
Jul 30 23:34:20.448470 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:20.448320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerStarted","Data":"2dad55634e1f08fd4ef4fe256a73a38cadf71d24a5f4ade0b77d82fc40f67e4b"}
Jul 30 23:34:20.469276 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:20.469231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podStartSLOduration=1.469216519 podStartE2EDuration="1.469216519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:34:20.468336735 +0000 UTC m=+3241.733582676" watchObservedRunningTime="2026-07-30 23:34:20.469216519 +0000 UTC m=+3241.734462534"
Jul 30 23:34:20.763536 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:20.763505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:20.768340 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:20.768316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:21.453782 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:21.453746    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:21.454692 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:21.454674    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:27.099381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:27.099341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:34:36.841923 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:36.841896    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": read tcp 10.133.0.2:59576->10.133.0.77:15021: read: connection reset by peer" start-of-body=
Jul 30 23:34:36.842328 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:36.841962    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": read tcp 10.133.0.2:59576->10.133.0.77:15021: read: connection reset by peer"
Jul 30 23:34:37.577062 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.577025    2559 generic.go:356] "Generic (PLEG): container finished" podID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerID="0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2" exitCode=0
Jul 30 23:34:37.577270 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.577114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerDied","Data":"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"}
Jul 30 23:34:37.577533 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.577520    2559 scope.go:117] "RemoveContainer" containerID="0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"
Jul 30 23:34:37.578655 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.578627    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:37.578722 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.578695    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:37.578762 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:37.578727    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:34:38.584647 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:38.584607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerStarted","Data":"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"}
Jul 30 23:34:38.762606 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:38.762565    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:38.762850 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:38.762825    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 30 23:34:38.762904 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:38.762875    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 30 23:34:39.763602 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:39.763562    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 30 23:34:39.763998 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:39.763624    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 30 23:34:40.763549 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:40.763501    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 30 23:34:40.763751 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:40.763565    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 30 23:34:41.763484 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:41.763438    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 30 23:34:41.763708 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:41.763519    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 30 23:34:42.763018 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:42.762978    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 30 23:34:42.763435 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:42.763032    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 30 23:34:43.767155 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:43.767124    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:43.767573 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:43.767552    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:34:43.768431 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:34:43.768413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:35:06.709959 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:35:06.709906    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:35:40.403086 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:35:40.402996    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:36:03.092632 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:03.092587    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:36:14.621880 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.621840    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:36:14.625395 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.625373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.627903 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.627880    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6a2f66-openshift-default-dockercfg-wp52k\""
Jul 30 23:36:14.636519 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.636491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:36:14.748715 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56p9p\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748715 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.748958 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.749161 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.748976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.749161 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.749013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850405 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56p9p\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850604 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.850947 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.851017 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.851017 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.850988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.851167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.851040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.851167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.851064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.851433 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.851370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.853141 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.853090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.853264 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.853190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.860024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.859999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.860177 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.860077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56p9p\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p\") pod \"e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") " pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:14.937243 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:14.937146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:15.087266 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.087064    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:36:15.089702 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:36:15.089675    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae74df9_cd00_4848_b112_72d6c6722736.slice/crio-00c66f825eb982ca6342ec4121a88bc46df5313062a9bb2867b474f6b2000373 WatchSource:0}: Error finding container 00c66f825eb982ca6342ec4121a88bc46df5313062a9bb2867b474f6b2000373: Status 404 returned error can't find the container with id 00c66f825eb982ca6342ec4121a88bc46df5313062a9bb2867b474f6b2000373
Jul 30 23:36:15.091944 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.091911    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:15.092017 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.091980    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:15.092017 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.092007    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:15.164575 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.164540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerStarted","Data":"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"}
Jul 30 23:36:15.164807 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.164601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerStarted","Data":"00c66f825eb982ca6342ec4121a88bc46df5313062a9bb2867b474f6b2000373"}
Jul 30 23:36:15.186320 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.186258    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podStartSLOduration=1.186241357 podStartE2EDuration="1.186241357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:36:15.182704392 +0000 UTC m=+3356.447950330" watchObservedRunningTime="2026-07-30 23:36:15.186241357 +0000 UTC m=+3356.451487293"
Jul 30 23:36:15.938036 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:15.937995    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:16.943728 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:16.943700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:17.176268 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:17.176231    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:17.177344 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:17.177323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:21.903418 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:21.903381    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:36:31.275692 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.275660    2559 generic.go:356] "Generic (PLEG): container finished" podID="dae74df9-cd00-4848-b112-72d6c6722736" containerID="5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a" exitCode=0
Jul 30 23:36:31.276119 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.275735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerDied","Data":"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"}
Jul 30 23:36:31.276218 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.276203    2559 scope.go:117] "RemoveContainer" containerID="5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"
Jul 30 23:36:31.277390 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.277363    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:31.277461 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.277431    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:31.277502 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:31.277462    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 30 23:36:32.176926 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:32.176887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:32.284484 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:32.284448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerStarted","Data":"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"}
Jul 30 23:36:32.939246 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:32.939196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:32.939626 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:32.939588    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 30 23:36:32.939787 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:32.939660    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 30 23:36:33.937914 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:33.937860    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 30 23:36:33.938466 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:33.937940    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 30 23:36:34.938086 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:34.938042    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 30 23:36:34.938755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:34.938718    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 30 23:36:35.938452 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:35.938406    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 30 23:36:35.939040 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:35.939008    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 30 23:36:36.938248 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:36.938205    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 30 23:36:36.938571 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:36.938541    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 30 23:36:37.942762 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:37.942728    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:37.943205 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:37.943015    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:37.943806 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:37.943787    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:36:51.998474 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:51.998440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:36:55.494454 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:55.494418    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:36:55.494913 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:36:55.494639    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy" containerID="cri-o://afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403" gracePeriod=30
Jul 30 23:37:00.749766 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.749739    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:37:00.793217 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793217 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793183    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793217 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793212    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793265    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793308    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793343    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56p9p\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p\") pod \"dae74df9-cd00-4848-b112-72d6c6722736\" (UID: \"dae74df9-cd00-4848-b112-72d6c6722736\") "
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793539    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793551    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data" (OuterVolumeSpecName: "istio-data") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793604    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793772    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae74df9-cd00-4848-b112-72d6c6722736-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793814    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793827    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793835    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.793838 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.793770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:37:00.795796 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.795770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p" (OuterVolumeSpecName: "kube-api-access-56p9p") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "kube-api-access-56p9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:37:00.795901 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.795820    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:37:00.796090 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.796071    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token" (OuterVolumeSpecName: "istio-token") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:37:00.796181 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.796130    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dae74df9-cd00-4848-b112-72d6c6722736" (UID: "dae74df9-cd00-4848-b112-72d6c6722736"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:37:00.894523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.894482    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.894523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.894515    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae74df9-cd00-4848-b112-72d6c6722736-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.894523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.894524    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.894523 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.894534    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56p9p\" (UniqueName: \"kubernetes.io/projected/dae74df9-cd00-4848-b112-72d6c6722736-kube-api-access-56p9p\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:00.894805 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:00.894543    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae74df9-cd00-4848-b112-72d6c6722736-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:37:01.458825 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.458794    2559 generic.go:356] "Generic (PLEG): container finished" podID="dae74df9-cd00-4848-b112-72d6c6722736" containerID="afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403" exitCode=0
Jul 30 23:37:01.459009 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.458851    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"
Jul 30 23:37:01.459009 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.458876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerDied","Data":"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"}
Jul 30 23:37:01.459009 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.458927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9" event={"ID":"dae74df9-cd00-4848-b112-72d6c6722736","Type":"ContainerDied","Data":"00c66f825eb982ca6342ec4121a88bc46df5313062a9bb2867b474f6b2000373"}
Jul 30 23:37:01.459009 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.458948    2559 scope.go:117] "RemoveContainer" containerID="afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"
Jul 30 23:37:01.468745 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.468724    2559 scope.go:117] "RemoveContainer" containerID="5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"
Jul 30 23:37:01.477243 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.477214    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:37:01.478412 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.478391    2559 scope.go:117] "RemoveContainer" containerID="afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"
Jul 30 23:37:01.478849 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:37:01.478828    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403\": container with ID starting with afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403 not found: ID does not exist" containerID="afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"
Jul 30 23:37:01.478950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.478859    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403"} err="failed to get container status \"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403\": rpc error: code = NotFound desc = could not find container \"afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403\": container with ID starting with afd5696f20e43ba518f1f2d1346bac8ee4c8820d505a710f4e040c6dc7833403 not found: ID does not exist"
Jul 30 23:37:01.478950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.478883    2559 scope.go:117] "RemoveContainer" containerID="5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"
Jul 30 23:37:01.479218 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:37:01.479197    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a\": container with ID starting with 5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a not found: ID does not exist" containerID="5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"
Jul 30 23:37:01.479328 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.479222    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a"} err="failed to get container status \"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a\": rpc error: code = NotFound desc = could not find container \"5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a\": container with ID starting with 5841255299a5126da35979648d9aacd000a602f74ca1385e39e5ac22842f420a not found: ID does not exist"
Jul 30 23:37:01.481178 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:01.481159    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6a2f66-openshift-default-66447d58fd-p84w9"]
Jul 30 23:37:03.240561 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:03.240527    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae74df9-cd00-4848-b112-72d6c6722736" path="/var/lib/kubelet/pods/dae74df9-cd00-4848-b112-72d6c6722736/volumes"
Jul 30 23:37:12.692853 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:12.692814    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:37:21.703196 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:37:21.703151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:38:17.336283 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:17.336245    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:38:17.336894 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:17.336464    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy" containerID="cri-o://4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33" gracePeriod=30
Jul 30 23:38:22.599210 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.599145    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:38:22.697816 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.697773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.697877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.697913    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9v8d\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.697939    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.697961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698004    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698032 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698027    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698141    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert\") pod \"fccee9a4-981a-497c-9c5b-52d6385431bf\" (UID: \"fccee9a4-981a-497c-9c5b-52d6385431bf\") "
Jul 30 23:38:22.698381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698216    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:22.698381 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:22.698645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698387    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:22.698645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698532    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.698645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698551    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.698645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698565    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.698645 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698583    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:38:22.698931 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.698895    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:22.700247 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.700227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d" (OuterVolumeSpecName: "kube-api-access-b9v8d") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "kube-api-access-b9v8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:22.700466 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.700430    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:38:22.700686 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.700664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:22.700686 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.700669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fccee9a4-981a-497c-9c5b-52d6385431bf" (UID: "fccee9a4-981a-497c-9c5b-52d6385431bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:22.799432 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799396    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.799432 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799426    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fccee9a4-981a-497c-9c5b-52d6385431bf-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.799432 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799436    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.799432 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799444    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9v8d\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-kube-api-access-b9v8d\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.799708 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799455    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fccee9a4-981a-497c-9c5b-52d6385431bf-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.799708 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.799463    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fccee9a4-981a-497c-9c5b-52d6385431bf-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:22.955961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.955874    2559 generic.go:356] "Generic (PLEG): container finished" podID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerID="4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33" exitCode=0
Jul 30 23:38:22.955961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.955924    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"
Jul 30 23:38:22.955961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.955951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerDied","Data":"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"}
Jul 30 23:38:22.956221 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.956005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p" event={"ID":"fccee9a4-981a-497c-9c5b-52d6385431bf","Type":"ContainerDied","Data":"2dad55634e1f08fd4ef4fe256a73a38cadf71d24a5f4ade0b77d82fc40f67e4b"}
Jul 30 23:38:22.956221 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.956027    2559 scope.go:117] "RemoveContainer" containerID="4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"
Jul 30 23:38:22.969817 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.969790    2559 scope.go:117] "RemoveContainer" containerID="0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"
Jul 30 23:38:22.980225 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.980197    2559 scope.go:117] "RemoveContainer" containerID="4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"
Jul 30 23:38:22.980974 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:38:22.980941    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33\": container with ID starting with 4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33 not found: ID does not exist" containerID="4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"
Jul 30 23:38:22.981125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.980996    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33"} err="failed to get container status \"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33\": rpc error: code = NotFound desc = could not find container \"4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33\": container with ID starting with 4d6891e3b49b89094a71b69343744f612a5d0dcfeae78a21d442c5a08369ba33 not found: ID does not exist"
Jul 30 23:38:22.981125 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.981022    2559 scope.go:117] "RemoveContainer" containerID="0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"
Jul 30 23:38:22.981377 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:38:22.981354    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2\": container with ID starting with 0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2 not found: ID does not exist" containerID="0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"
Jul 30 23:38:22.981492 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.981465    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2"} err="failed to get container status \"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2\": rpc error: code = NotFound desc = could not find container \"0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2\": container with ID starting with 0109feb30d8d8789f87f42d7b2c8c8d9066000cfb206f083217c0567349198d2 not found: ID does not exist"
Jul 30 23:38:22.981616 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.981604    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:38:22.984091 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:22.984072    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-287423-openshift-default-cb49c5766-57k6p"]
Jul 30 23:38:23.240697 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:23.240665    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" path="/var/lib/kubelet/pods/fccee9a4-981a-497c-9c5b-52d6385431bf/volumes"
Jul 30 23:38:30.492121 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:30.492067    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:38:45.767951 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:45.767864    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"]
Jul 30 23:38:45.771871 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:45.771842    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-80952f-29757570-8pdvp"]
Jul 30 23:38:47.240531 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:47.240493    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044bb921-9e65-4f7b-aba7-4efeb68355a3" path="/var/lib/kubelet/pods/044bb921-9e65-4f7b-aba7-4efeb68355a3/volumes"
Jul 30 23:38:48.012799 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:48.012760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:38:52.825383 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:52.825348    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:38:52.825968 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:52.825579    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" containerID="cri-o://a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b" gracePeriod=30
Jul 30 23:38:57.883353 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:57.883310    2559 patch_prober.go:28] interesting pod/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 30 23:38:57.883747 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:57.883387    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 30 23:38:58.075621 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.075592    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:38:58.130180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130269    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl7ft\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft\") pod \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\" (UID: \"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd\") "
Jul 30 23:38:58.130422 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130537    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130552    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130728    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130750    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130761    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130770    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.130786 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.130725    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:38:58.132545 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.132520    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft" (OuterVolumeSpecName: "kube-api-access-dl7ft") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "kube-api-access-dl7ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:58.132700 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.132675    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:38:58.132764 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.132701    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:58.132818 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.132771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" (UID: "82c8baf6-dd4d-4dfd-a3b5-cea9535473cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:58.159833 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.159798    2559 generic.go:356] "Generic (PLEG): container finished" podID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerID="a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b" exitCode=0
Jul 30 23:38:58.159993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.159852    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"
Jul 30 23:38:58.159993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.159852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerDied","Data":"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"}
Jul 30 23:38:58.159993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.159935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l" event={"ID":"82c8baf6-dd4d-4dfd-a3b5-cea9535473cd","Type":"ContainerDied","Data":"17c7a974e35ff39c2e8ddd3508cf8ce69bd263da0b227ea3cf72f0a24b2ee71c"}
Jul 30 23:38:58.159993 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.159967    2559 scope.go:117] "RemoveContainer" containerID="a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"
Jul 30 23:38:58.172519 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.172498    2559 scope.go:117] "RemoveContainer" containerID="e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"
Jul 30 23:38:58.181986 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.181965    2559 scope.go:117] "RemoveContainer" containerID="a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"
Jul 30 23:38:58.182377 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:38:58.182354    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b\": container with ID starting with a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b not found: ID does not exist" containerID="a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"
Jul 30 23:38:58.182475 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.182385    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b"} err="failed to get container status \"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b\": rpc error: code = NotFound desc = could not find container \"a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b\": container with ID starting with a6e76148c9299805ad8e4009547df61b8dec1c714df2cdf226711bb2c339727b not found: ID does not exist"
Jul 30 23:38:58.182475 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.182406    2559 scope.go:117] "RemoveContainer" containerID="e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"
Jul 30 23:38:58.182675 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:38:58.182657    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90\": container with ID starting with e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90 not found: ID does not exist" containerID="e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"
Jul 30 23:38:58.182722 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.182681    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90"} err="failed to get container status \"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90\": rpc error: code = NotFound desc = could not find container \"e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90\": container with ID starting with e41c4635727390af90ff8b0e377413c17679dc3a5690fe35bbeb594259d8ce90 not found: ID does not exist"
Jul 30 23:38:58.184027 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.184005    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:38:58.189200 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.189174    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-80952f-openshift-default-5677dcccb-lmr8l"]
Jul 30 23:38:58.231875 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.231838    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.231875 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.231866    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.231875 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.231877    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.231875 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.231884    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:58.232180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:58.231892    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl7ft\" (UniqueName: \"kubernetes.io/projected/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd-kube-api-access-dl7ft\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:38:59.240083 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:38:59.240039    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" path="/var/lib/kubelet/pods/82c8baf6-dd4d-4dfd-a3b5-cea9535473cd/volumes"
Jul 30 23:39:03.619036 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:03.618984    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"]
Jul 30 23:39:03.621463 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:03.621437    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bb1098-29757570-pvc4g"]
Jul 30 23:39:05.240143 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:05.240085    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1f8f15f-5792-43db-aeca-4fa2b1d5c429" path="/var/lib/kubelet/pods/c1f8f15f-5792-43db-aeca-4fa2b1d5c429/volumes"
Jul 30 23:39:05.806902 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:05.806860    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-xbgpz"]
Jul 30 23:39:10.416630 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:10.416584    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:39:10.417124 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:10.416902    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" containerID="cri-o://171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f" gracePeriod=30
Jul 30 23:39:11.147613 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:11.147572    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7454bb44fc-9wfmk_b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c/authorino/0.log"
Jul 30 23:39:13.204478 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:13.204442    2559 patch_prober.go:28] interesting pod/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 23:39:13.204852 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:13.204504    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 23:39:15.670409 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.670375    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:39:15.797661 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797611    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbf6d\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797756    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797780    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.797895 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797892    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.798276 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.797917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs\") pod \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\" (UID: \"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf\") "
Jul 30 23:39:15.798615 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.798579    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:39:15.798765 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.798703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:39:15.798765 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.798731    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:39:15.799180 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.799136    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:39:15.799289 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.798073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:39:15.807019 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.806962    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:39:15.807284 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.807015    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:39:15.807417 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.807343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:39:15.807689 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.807664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d" (OuterVolumeSpecName: "kube-api-access-pbf6d") pod "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" (UID: "7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf"). InnerVolumeSpecName "kube-api-access-pbf6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:39:15.899755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899717    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-token\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.899755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899749    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-credential-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.899755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899759    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-certs\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.899755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899767    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-envoy\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.900024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899776    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbf6d\" (UniqueName: \"kubernetes.io/projected/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-kube-api-access-pbf6d\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.900024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899784    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-podinfo\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.900024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899791    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-workload-socket\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.900024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899799    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istio-data\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:15.900024 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:15.899806    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf-istiod-ca-cert\") on node \"ip-10-0-143-234.ec2.internal\" DevicePath \"\""
Jul 30 23:39:16.271461 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.271425    2559 generic.go:356] "Generic (PLEG): container finished" podID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerID="171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f" exitCode=0
Jul 30 23:39:16.271672 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.271475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerDied","Data":"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"}
Jul 30 23:39:16.271672 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.271500    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"
Jul 30 23:39:16.271672 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.271532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf" event={"ID":"7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf","Type":"ContainerDied","Data":"a33020fba89fc13968fd031b66f2c3c959d12d2f93870df0558be555e8ee8dba"}
Jul 30 23:39:16.271672 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.271554    2559 scope.go:117] "RemoveContainer" containerID="171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"
Jul 30 23:39:16.281667 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.281649    2559 scope.go:117] "RemoveContainer" containerID="8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"
Jul 30 23:39:16.290968 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.290685    2559 scope.go:117] "RemoveContainer" containerID="171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"
Jul 30 23:39:16.291054 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:39:16.290998    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f\": container with ID starting with 171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f not found: ID does not exist" containerID="171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"
Jul 30 23:39:16.291054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.291024    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f"} err="failed to get container status \"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f\": rpc error: code = NotFound desc = could not find container \"171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f\": container with ID starting with 171bcd7b299b176bc1c9f548db63b32a25a0221195c7c58b908a17588fa26f6f not found: ID does not exist"
Jul 30 23:39:16.291054 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.291044    2559 scope.go:117] "RemoveContainer" containerID="8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"
Jul 30 23:39:16.291382 ip-10-0-143-234 kubenswrapper[2559]: E0730 23:39:16.291362    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1\": container with ID starting with 8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1 not found: ID does not exist" containerID="8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"
Jul 30 23:39:16.291435 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.291389    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1"} err="failed to get container status \"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1\": rpc error: code = NotFound desc = could not find container \"8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1\": container with ID starting with 8ba37a512db2b6c9382215e3fa5280ec46ad3a464f7f25d79516334b6d2d3df1 not found: ID does not exist"
Jul 30 23:39:16.293071 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.293050    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:39:16.297775 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:16.297751    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bb1098-openshift-default-69765fd7d4-n6spf"]
Jul 30 23:39:17.222217 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:17.222185    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nx8mf_89c9a38b-e853-4f19-8322-5e23d2ed4702/server/0.log"
Jul 30 23:39:17.240346 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:17.240309    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" path="/var/lib/kubelet/pods/7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf/volumes"
Jul 30 23:39:17.477496 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:17.477417    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-7s4z8_98eb0ffc-9256-4d08-b708-8f3bd01c6678/manager/0.log"
Jul 30 23:39:17.486809 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:17.486783    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-7s4z8_98eb0ffc-9256-4d08-b708-8f3bd01c6678/copy-manifests/0.log"
Jul 30 23:39:18.240950 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:18.240919    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757540-ljvjf_7d572bf4-b94b-452c-b4a1-b9d0c21d6cf1/cleanup/0.log"
Jul 30 23:39:18.353010 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:18.352983    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757555-bpq5b_a36cc91b-a843-46de-bdd7-8e586362d6ec/cleanup/0.log"
Jul 30 23:39:19.425490 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:19.425454    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7454bb44fc-9wfmk_b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c/authorino/0.log"
Jul 30 23:39:19.814673 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:19.814639    2559 scope.go:117] "RemoveContainer" containerID="e5057cba73301d7efcdd8f1760fbf2ff29264d455979e2f45bc541fa9e99095c"
Jul 30 23:39:19.826530 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:19.826510    2559 scope.go:117] "RemoveContainer" containerID="286453426b658e50d3b984d4d8b449df980f5da2a651087d3dca9f48ef7bf17f"
Jul 30 23:39:20.028698 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:20.028665    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-xbgpz_2b5b355c-9750-439a-bacc-14f161615764/limitador/0.log"
Jul 30 23:39:20.744254 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:20.744224    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9c58d584-hdbzd_c3992245-71c1-45a0-8a8e-106ccba4be34/kube-auth-proxy/0.log"
Jul 30 23:39:28.121403 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121363    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nv5zt/must-gather-9cn7m"]
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121772    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121788    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121795    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121803    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121809    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121829    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121834    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121838    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121846    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121851    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121858    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.121872 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121863    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121915    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121929    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc0cf69-b51d-4fc6-a814-ebe15c73cfbf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121935    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121940    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121946    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.121954    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c8baf6-dd4d-4dfd-a3b5-cea9535473cd" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.122013    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.122019    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fccee9a4-981a-497c-9c5b-52d6385431bf" containerName="istio-proxy"
Jul 30 23:39:28.122366 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.122072    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae74df9-cd00-4848-b112-72d6c6722736" containerName="istio-proxy"
Jul 30 23:39:28.127167 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.127147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.129999 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.129975    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nv5zt\"/\"kube-root-ca.crt\""
Jul 30 23:39:28.130196 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.129976    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nv5zt\"/\"default-dockercfg-7rfhb\""
Jul 30 23:39:28.130956 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.130927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nv5zt\"/\"openshift-service-ca.crt\""
Jul 30 23:39:28.133755 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.133733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/must-gather-9cn7m"]
Jul 30 23:39:28.313065 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.313022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjx24\" (UniqueName: \"kubernetes.io/projected/89392cbe-d894-48b0-9acc-f7fef4faf6b9-kube-api-access-mjx24\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.313281 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.313228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89392cbe-d894-48b0-9acc-f7fef4faf6b9-must-gather-output\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.414178 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.414072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjx24\" (UniqueName: \"kubernetes.io/projected/89392cbe-d894-48b0-9acc-f7fef4faf6b9-kube-api-access-mjx24\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.414334 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.414181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89392cbe-d894-48b0-9acc-f7fef4faf6b9-must-gather-output\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.414538 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.414517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89392cbe-d894-48b0-9acc-f7fef4faf6b9-must-gather-output\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.422752 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.422724    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjx24\" (UniqueName: \"kubernetes.io/projected/89392cbe-d894-48b0-9acc-f7fef4faf6b9-kube-api-access-mjx24\") pod \"must-gather-9cn7m\" (UID: \"89392cbe-d894-48b0-9acc-f7fef4faf6b9\") " pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.437802 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.437766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/must-gather-9cn7m"
Jul 30 23:39:28.578387 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.578355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/must-gather-9cn7m"]
Jul 30 23:39:28.580902 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:39:28.580873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89392cbe_d894_48b0_9acc_f7fef4faf6b9.slice/crio-9af63d2536118d629991b5833ed48867add182784675c1deb37d3adda0db1c5c WatchSource:0}: Error finding container 9af63d2536118d629991b5833ed48867add182784675c1deb37d3adda0db1c5c: Status 404 returned error can't find the container with id 9af63d2536118d629991b5833ed48867add182784675c1deb37d3adda0db1c5c
Jul 30 23:39:28.583194 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:28.583176    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:39:29.348171 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:29.348131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/must-gather-9cn7m" event={"ID":"89392cbe-d894-48b0-9acc-f7fef4faf6b9","Type":"ContainerStarted","Data":"9af63d2536118d629991b5833ed48867add182784675c1deb37d3adda0db1c5c"}
Jul 30 23:39:30.358541 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:30.358503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/must-gather-9cn7m" event={"ID":"89392cbe-d894-48b0-9acc-f7fef4faf6b9","Type":"ContainerStarted","Data":"66272d68683bc9a90ece9e2f659e45851fd09caa85783f44e61d37f1aa26b750"}
Jul 30 23:39:30.358935 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:30.358556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/must-gather-9cn7m" event={"ID":"89392cbe-d894-48b0-9acc-f7fef4faf6b9","Type":"ContainerStarted","Data":"3af4ddf18f1a0aef317fdab3a72dc6caf076ddd96fac81a8ab4f4c59b092f553"}
Jul 30 23:39:30.373508 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:30.373453    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nv5zt/must-gather-9cn7m" podStartSLOduration=1.51198357 podStartE2EDuration="2.373431364s" totalImagesPullingTime="861.447794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:39:30.372900194 +0000 UTC m=+3551.638146143" watchObservedRunningTime="2026-07-30 23:39:30.373431364 +0000 UTC m=+3551.638677300"
Jul 30 23:39:31.086725 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:31.086694    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mbpsh_b764ae7b-67f3-4752-abe4-d930ecc39ffe/global-pull-secret-syncer/0.log"
Jul 30 23:39:31.182091 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:31.182057    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hr8fx_ea0da7d1-084d-4141-b232-24d31d900c4c/konnectivity-agent/0.log"
Jul 30 23:39:31.288293 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:31.288258    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-234.ec2.internal_4d051237fd0551e063798067bc184f11/haproxy/0.log"
Jul 30 23:39:36.232294 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:36.231829    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7454bb44fc-9wfmk_b5c8d8bf-0fc2-4176-9dc9-6e5ab00c108c/authorino/0.log"
Jul 30 23:39:36.432951 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:36.432921    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-xbgpz_2b5b355c-9750-439a-bacc-14f161615764/limitador/0.log"
Jul 30 23:39:37.855365 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.855297    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/alertmanager/0.log"
Jul 30 23:39:37.877683 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.877636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/config-reloader/0.log"
Jul 30 23:39:37.900509 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.900476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/kube-rbac-proxy-web/0.log"
Jul 30 23:39:37.923693 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.923662    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/kube-rbac-proxy/0.log"
Jul 30 23:39:37.945585 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.945551    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/kube-rbac-proxy-metric/0.log"
Jul 30 23:39:37.978744 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:37.978713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/prom-label-proxy/0.log"
Jul 30 23:39:38.014853 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.014820    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c0a09533-f301-4726-baea-4a7d33b62b99/init-config-reloader/0.log"
Jul 30 23:39:38.220427 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.220348    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8jftw_9c0b51a8-b609-4e6f-ac74-9a4b5734fe34/kube-state-metrics/0.log"
Jul 30 23:39:38.248359 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.248328    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8jftw_9c0b51a8-b609-4e6f-ac74-9a4b5734fe34/kube-rbac-proxy-main/0.log"
Jul 30 23:39:38.275442 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.275410    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8jftw_9c0b51a8-b609-4e6f-ac74-9a4b5734fe34/kube-rbac-proxy-self/0.log"
Jul 30 23:39:38.305569 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.303502    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dcc645679-vndxt_9a3ab9c9-e3c2-41ae-a3a4-c6356897e963/metrics-server/0.log"
Jul 30 23:39:38.350256 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.350222    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-qvhhz_94c1a2b0-e27e-4ea6-ab20-a9ad9a67633b/monitoring-plugin/0.log"
Jul 30 23:39:38.546129 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.545636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqm85_77938e2d-1547-4b8e-acee-f855256c97d1/node-exporter/0.log"
Jul 30 23:39:38.574864 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.574832    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqm85_77938e2d-1547-4b8e-acee-f855256c97d1/kube-rbac-proxy/0.log"
Jul 30 23:39:38.598757 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.598731    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqm85_77938e2d-1547-4b8e-acee-f855256c97d1/init-textfile/0.log"
Jul 30 23:39:38.640430 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.640397    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bh6lr_6082251b-5e85-4b69-8225-fd88e4e03680/kube-rbac-proxy-main/0.log"
Jul 30 23:39:38.666952 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.666917    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bh6lr_6082251b-5e85-4b69-8225-fd88e4e03680/kube-rbac-proxy-self/0.log"
Jul 30 23:39:38.697168 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.697128    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bh6lr_6082251b-5e85-4b69-8225-fd88e4e03680/openshift-state-metrics/0.log"
Jul 30 23:39:38.904938 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.904841    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-nh2td_20b51c8d-d7a7-4d27-8128-6ecad0b930ba/prometheus-operator/0.log"
Jul 30 23:39:38.924457 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.924416    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-nh2td_20b51c8d-d7a7-4d27-8128-6ecad0b930ba/kube-rbac-proxy/0.log"
Jul 30 23:39:38.951798 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.951765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-brm9m_8c0d622a-669f-4880-9ea8-fd19fbaf9ebc/prometheus-operator-admission-webhook/0.log"
Jul 30 23:39:38.984400 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:38.984326    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685f866dd5-6cwh5_c537f07c-1a73-453c-bc19-435edd558989/telemeter-client/0.log"
Jul 30 23:39:39.008592 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.008561    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685f866dd5-6cwh5_c537f07c-1a73-453c-bc19-435edd558989/reload/0.log"
Jul 30 23:39:39.033026 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.032992    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685f866dd5-6cwh5_c537f07c-1a73-453c-bc19-435edd558989/kube-rbac-proxy/0.log"
Jul 30 23:39:39.076233 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.076208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/thanos-query/0.log"
Jul 30 23:39:39.105539 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.105513    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/kube-rbac-proxy-web/0.log"
Jul 30 23:39:39.127965 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.127933    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/kube-rbac-proxy/0.log"
Jul 30 23:39:39.150083 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.150051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/prom-label-proxy/0.log"
Jul 30 23:39:39.172997 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.172915    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/kube-rbac-proxy-rules/0.log"
Jul 30 23:39:39.196322 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:39.196287    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78c48f87d7-8k8wj_4bc7f6f8-30a1-4305-ab8f-f54efe3aabd1/kube-rbac-proxy-metrics/0.log"
Jul 30 23:39:41.404866 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.404832    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"]
Jul 30 23:39:41.410949 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.410918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.416540 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.416507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"]
Jul 30 23:39:41.463707 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.463668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-podres\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.463942 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.463729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-lib-modules\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.463942 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.463907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-proc\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.464075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.463949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-sys\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.464075 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.463994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvv5\" (UniqueName: \"kubernetes.io/projected/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-kube-api-access-slvv5\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565552 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-proc\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565748 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-sys\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565748 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvv5\" (UniqueName: \"kubernetes.io/projected/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-kube-api-access-slvv5\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565748 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565653    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-podres\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565748 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-lib-modules\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.565984 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.565940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-lib-modules\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.566039 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.566025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-proc\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.566113 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.566072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-sys\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.566227 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.566202    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-podres\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.574401 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.574331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvv5\" (UniqueName: \"kubernetes.io/projected/1a5b5b39-d8f4-4b8a-be9e-acab580ebf41-kube-api-access-slvv5\") pod \"perf-node-gather-daemonset-mwjsg\" (UID: \"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41\") " pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.608977 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.608945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78664495b8-s69bh_80ed9575-5614-40ab-8bc3-bfbd869f2e22/console/0.log"
Jul 30 23:39:41.654495 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.654463    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-cn542_0a2b87ee-1eb4-4e75-b74d-49095813c309/download-server/0.log"
Jul 30 23:39:41.727453 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.727118    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:41.914667 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:41.913405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"]
Jul 30 23:39:41.916303 ip-10-0-143-234 kubenswrapper[2559]: W0730 23:39:41.916257    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a5b5b39_d8f4_4b8a_be9e_acab580ebf41.slice/crio-a40227d3702450ecb98218fe0b8a13b53d5aba561bf32852a5094c327fb8af15 WatchSource:0}: Error finding container a40227d3702450ecb98218fe0b8a13b53d5aba561bf32852a5094c327fb8af15: Status 404 returned error can't find the container with id a40227d3702450ecb98218fe0b8a13b53d5aba561bf32852a5094c327fb8af15
Jul 30 23:39:42.481822 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:42.481781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg" event={"ID":"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41","Type":"ContainerStarted","Data":"39e37d78419c72d007bed5167d233ba171a4f9fc4dc695785a4fa0c9355c451f"}
Jul 30 23:39:42.482324 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:42.481850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg" event={"ID":"1a5b5b39-d8f4-4b8a-be9e-acab580ebf41","Type":"ContainerStarted","Data":"a40227d3702450ecb98218fe0b8a13b53d5aba561bf32852a5094c327fb8af15"}
Jul 30 23:39:42.482679 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:42.482653    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:42.498406 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:42.498345    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg" podStartSLOduration=1.498323965 podStartE2EDuration="1.498323965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 23:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:39:42.497671867 +0000 UTC m=+3563.762917804" watchObservedRunningTime="2026-07-30 23:39:42.498323965 +0000 UTC m=+3563.763569903"
Jul 30 23:39:43.437936 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:43.437890    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-77f27_28888643-211e-4cbf-aa44-6dcbb5d47646/dns/0.log"
Jul 30 23:39:43.458769 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:43.458733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-77f27_28888643-211e-4cbf-aa44-6dcbb5d47646/kube-rbac-proxy/0.log"
Jul 30 23:39:43.530109 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:43.530064    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8t95k_e67ebb8c-e370-400c-8b66-01f0dfdaff1d/dns-node-resolver/0.log"
Jul 30 23:39:44.180230 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:44.180202    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xck9c_61b5cc6a-9cdd-418b-8f12-97b0b0a12bf7/node-ca/0.log"
Jul 30 23:39:45.267444 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:45.267408    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9c58d584-hdbzd_c3992245-71c1-45a0-8a8e-106ccba4be34/kube-auth-proxy/0.log"
Jul 30 23:39:46.257779 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:46.257744    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sb8tp_0662dea7-b993-483c-873d-0c6ffc667327/serve-healthcheck-canary/0.log"
Jul 30 23:39:46.730693 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:46.730669    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl2st_1ec5a8da-0990-4c50-afc0-f37c77b49d3e/kube-rbac-proxy/0.log"
Jul 30 23:39:46.753638 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:46.753601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl2st_1ec5a8da-0990-4c50-afc0-f37c77b49d3e/exporter/0.log"
Jul 30 23:39:46.774493 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:46.774459    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl2st_1ec5a8da-0990-4c50-afc0-f37c77b49d3e/extractor/0.log"
Jul 30 23:39:49.324807 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:49.324780    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nx8mf_89c9a38b-e853-4f19-8322-5e23d2ed4702/server/0.log"
Jul 30 23:39:49.518611 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:49.518573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nv5zt/perf-node-gather-daemonset-mwjsg"
Jul 30 23:39:49.548447 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:49.548405    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-7s4z8_98eb0ffc-9256-4d08-b708-8f3bd01c6678/manager/0.log"
Jul 30 23:39:49.567502 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:49.567474    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ff8c5f475-7s4z8_98eb0ffc-9256-4d08-b708-8f3bd01c6678/copy-manifests/0.log"
Jul 30 23:39:51.025357 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:51.025313    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c6cc5589b-7vqmc_47549563-ba06-420d-b22b-2bfabefc7a90/manager/0.log"
Jul 30 23:39:52.001248 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:52.001215    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9c58d584-hdbzd_c3992245-71c1-45a0-8a8e-106ccba4be34/kube-auth-proxy/0.log"
Jul 30 23:39:53.726961 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:53.726937    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9c58d584-hdbzd_c3992245-71c1-45a0-8a8e-106ccba4be34/kube-auth-proxy/0.log"
Jul 30 23:39:57.743464 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.743434    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/kube-multus-additional-cni-plugins/0.log"
Jul 30 23:39:57.777939 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.777910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/egress-router-binary-copy/0.log"
Jul 30 23:39:57.798727 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.798698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/cni-plugins/0.log"
Jul 30 23:39:57.819221 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.819187    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/bond-cni-plugin/0.log"
Jul 30 23:39:57.840079 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.840052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/routeoverride-cni/0.log"
Jul 30 23:39:57.860849 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.860813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/whereabouts-cni-bincopy/0.log"
Jul 30 23:39:57.880544 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:57.880509    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ng5lj_20ef592c-f028-41ec-b869-6495c7a98159/whereabouts-cni/0.log"
Jul 30 23:39:58.107855 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:58.107773    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f62tp_db9b30f2-a0fe-4989-8752-76e402360862/kube-multus/0.log"
Jul 30 23:39:58.165691 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:58.165656    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dfp9_de59c87b-7872-423b-bdf2-d6f519e5018a/network-metrics-daemon/0.log"
Jul 30 23:39:58.181673 ip-10-0-143-234 kubenswrapper[2559]: I0730 23:39:58.181647    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dfp9_de59c87b-7872-423b-bdf2-d6f519e5018a/kube-rbac-proxy/0.log"