Jul 09 16:48:50.485572 ip-10-0-135-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 16:48:50.485584 ip-10-0-135-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 16:48:50.485592 ip-10-0-135-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 16:48:50.485889 ip-10-0-135-121 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 16:49:00.495872 ip-10-0-135-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 16:49:00.495888 ip-10-0-135-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8e06548e2e63425ebf4bcbc7244aa757 --
Jul 09 16:50:39.277223 ip-10-0-135-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.684169    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688715    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688744    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688749    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688754    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688760    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688764    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688768    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:39.697500 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688773    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688777    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688781    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688786    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688792    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688796    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688806    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688811    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688815    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688819    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688824    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688828    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688832    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688839    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688845    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688850    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688854    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688858    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688862    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688871    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:39.744988 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688876    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688880    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688884    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688888    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688893    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688919    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688924    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688929    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688932    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688935    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688960    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688980    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688986    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688992    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.688997    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689003    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689008    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689013    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689018    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689022    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:39.762486 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689027    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:39.758165 ip-10-0-135-121 systemd[1]: Started Kubernetes Kubelet.
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689033    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689037    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689048    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689052    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689057    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689061    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689066    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689075    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689107    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689127    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689241    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689251    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689255    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689259    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689264    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689267    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689271    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689275    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:39.983502 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689279    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689283    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689287    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689294    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689299    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689304    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689309    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689314    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689318    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689322    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689326    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689331    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689335    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689339    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689343    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689347    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689353    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689357    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689361    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:39.993476 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689364    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689371    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689376    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689380    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689384    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689388    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689392    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689397    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689401    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689405    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689409    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689414    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689418    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.689423    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.690995    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691003    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691007    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691010    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691013    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691015    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:39.994388 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691018    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691021    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691024    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691030    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691033    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691035    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691038    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691041    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691043    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691046    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691049    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691052    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691056    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691058    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691061    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691065    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691068    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691070    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691073    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691076    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:39.995193 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691078    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691081    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691083    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691086    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691089    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691091    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691094    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691096    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691099    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691102    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691105    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691107    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691110    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691113    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691116    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691120    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691123    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691125    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691128    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691130    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:39.995803 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691133    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691135    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691138    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691141    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691145    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691147    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691155    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691158    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691162    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691164    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691167    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691169    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691172    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691175    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691178    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691180    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691183    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691186    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691189    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691192    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:39.996622 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691194    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691197    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691200    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691202    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691205    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691208    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691211    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691215    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691217    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691220    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691223    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691225    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691228    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691230    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691233    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691236    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691241    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691246    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691249    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691252    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:39.997231 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691255    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691258    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691260    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691263    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691266    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691269    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691272    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691274    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691276    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691281    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691285    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691289    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691293    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691682    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691687    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691690    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691693    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691696    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:39.997863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691698    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691702    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691705    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691708    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691710    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691713    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691715    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691717    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691720    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691723    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691726    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691729    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691731    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691734    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691737    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691739    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691742    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691744    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691747    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691749    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:39.998434 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691752    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691754    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691756    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691762    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691764    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691766    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691769    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691771    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691774    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691777    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691779    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691781    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691784    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691788    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691791    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691794    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691796    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691799    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691801    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691804    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:39.999086 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691806    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691809    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691811    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691814    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691817    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691820    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691822    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691825    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691827    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691830    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691832    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691835    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691839    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691842    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691845    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691850    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691852    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691855    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691858    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:39.999788 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691860    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691863    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691866    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691868    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691871    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691874    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691879    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691882    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691884    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691887    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691889    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691892    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691894    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691897    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691899    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691923    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691927    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691930    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691934    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691937    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:40.000413 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691940    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691942    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691945    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691947    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691950    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691953    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691955    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691958    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691962    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691964    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691967    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691969    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691972    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691974    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.691977    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692053    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692064    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692073    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692081    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692087    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692092    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 16:50:40.001009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692098    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692103    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692106    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692109    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692113    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692116    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692119    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692122    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692125    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692128    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692132    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692135    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692141    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692144    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692147    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692150    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692154    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692162    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692166    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692170    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692174    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692177    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692180    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692183    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 16:50:40.001593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692186    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692189    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692193    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692197    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692200    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692204    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692207    2570 flags.go:64] FLAG: --enable-server="true"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692210    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692215    2570 flags.go:64] FLAG: --event-burst="100"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692218    2570 flags.go:64] FLAG: --event-qps="50"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692221    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692224    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692227    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692230    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692233    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692236    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692239    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692242    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692245    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692249    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692252    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692255    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692257    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692260    2570 flags.go:64] FLAG: --feature-gates=""
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692264    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 16:50:40.002238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692267    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692270    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692275    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692278    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692281    2570 flags.go:64] FLAG: --help="false"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692284    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692287    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692290    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692293    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692296    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692299    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692302    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692307    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692310    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692313    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692316    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692319    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692322    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692325    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692327    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692331    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692333    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692336    2570 flags.go:64] FLAG: --lock-file=""
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692339    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 16:50:40.002996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692342    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692345    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692350    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692354    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692357    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692360    2570 flags.go:64] FLAG: --logging-format="text"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692363    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692366    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692369    2570 flags.go:64] FLAG: --manifest-url=""
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692372    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692378    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692381    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692385    2570 flags.go:64] FLAG: --max-pods="110"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692388    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692391    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692393    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692396    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692399    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692402    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692405    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692414    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692417    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692420    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 16:50:40.003620 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692423    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692426    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692431    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692434    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692437    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692440    2570 flags.go:64] FLAG: --port="10250"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692443    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692446    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01429b079afe428be"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692449    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692452    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692455    2570 flags.go:64] FLAG: --register-node="true"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692459    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692463    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692466    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692469    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692472    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692476    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692479    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692482    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692486    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692489    2570 flags.go:64] FLAG: --runonce="false"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692492    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692495    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692499    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692501    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 16:50:40.004299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692504    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692507    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692510    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692513    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692516    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692521    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692524    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692527    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692530    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692533    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692536    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692541    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692544    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692547    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692551    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692554    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692557    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692560    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692563    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692566    2570 flags.go:64] FLAG: --v="2"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692570    2570 flags.go:64] FLAG: --version="false"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692576    2570 flags.go:64] FLAG: --vmodule=""
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692580    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.692584    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692701    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:40.004961 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692704    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692708    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692711    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692715    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692717    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692720    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692722    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692725    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692727    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692730    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692732    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692735    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692739    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692741    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692744    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692747    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692751    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692755    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692758    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:40.005655 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692761    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692763    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692766    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692769    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692772    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692776    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692780    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692784    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692787    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692789    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692793    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692795    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692798    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692800    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692805    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692807    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692810    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692812    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692815    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:40.006479 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692817    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692820    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692822    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692825    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692827    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692830    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692834    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692836    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692839    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692843    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692846    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692849    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692852    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692854    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692857    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692859    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692862    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692865    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692867    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692870    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:40.007210 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692873    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692875    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692878    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692880    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692883    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692886    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692889    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692893    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692896    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692898    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692901    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692919    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692922    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692924    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692927    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692930    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692933    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692935    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692941    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692944    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:40.159017 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692947    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692949    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692952    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692955    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692957    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692960    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692963    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692965    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692968    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692971    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692973    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692976    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692978    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692981    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692983    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692986    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692988    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692991    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692994    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:40.159715 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.692998    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.693836    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701011    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701026    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701045    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701054    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701110    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701116    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701119    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701122    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701125    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701128    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701132    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701135    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701137    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:40.160289 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701140    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701143    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701146    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701149    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701152    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701155    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701158    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701161    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701164    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701166    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701169    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701171    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701174    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701177    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701180    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701182    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701186    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701191    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701194    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701199    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:40.160729 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701202    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701205    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701207    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701210    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701212    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701215    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701219    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701223    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701226    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701229    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701232    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701235    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701238    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701240    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701243    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701246    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701248    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701251    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701253    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:40.161278 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701255    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701258    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701260    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701263    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701265    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701268    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701270    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701272    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701275    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701277    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701281    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701284    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701287    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701290    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701294    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701296    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701299    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701302    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701304    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701307    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:40.161863 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701309    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701312    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701315    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701318    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701320    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701323    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701325    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701328    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701331    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701333    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701336    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701338    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701341    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701343    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701346    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701348    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701351    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701353    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701356    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701358    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:40.162424 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701361    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701363    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701367    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701370    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701373    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701376    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701379    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701382    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701384    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701387    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701391    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701396    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701509    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701514    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 16:50:40.163013 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701517    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701522    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701525    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701527    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701530    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701533    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701535    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701538    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701541    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701543    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701546    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701548    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701551    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701553    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701557    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701560    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701563    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701566    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701569    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 16:50:40.163403 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701571    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701575    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701577    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701580    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701583    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701586    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701589    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701592    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701594    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701597    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701599    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701602    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701604    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701607    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701610    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701613    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701615    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701618    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701620    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701623    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 16:50:40.163948 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701625    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701628    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701630    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701633    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701635    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701638    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701640    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701643    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701645    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701648    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701650    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701653    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701655    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701659    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701661    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701664    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701669    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701673    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701676    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 16:50:40.164478 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701679    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701682    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701685    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701687    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701690    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701692    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701695    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701698    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701700    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701702    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701705    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701707    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701710    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701712    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701715    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701718    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701720    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701723    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701725    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 16:50:40.165033 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701728    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701730    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701733    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701735    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701738    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701740    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701743    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701746    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701749    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701751    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701755    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701758    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701760    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701763    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701765    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701768    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701771    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701773    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701776    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 16:50:40.165566 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:39.701778    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701783    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.701894    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.703897    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.705180    2570 server.go:1019] "Starting client certificate rotation"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.705282    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.705928    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.707509    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.708651    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.720083    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.723580    2570 log.go:25] "Validated CRI v1 image API"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.724474    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 16:50:40.166120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.730013    2570 fs.go:135] Filesystem UUIDs: map[4fe83ce5-cea2-48e7-a5a1-afaef7bea71b:/dev/nvme0n1p3 52c57f39-b48d-4a5b-b773-13d510a045e0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 09 16:50:40.166468 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.730032    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.735697    2570 manager.go:216] Machine: {Timestamp:2026-07-09 16:50:39.734413218 +0000 UTC m=+0.329799403 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086366 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bd7de14cf68e96443f72a69ddcabd SystemUUID:ec2bd7de-14cf-68e9-6443-f72a69ddcabd BootID:8e06548e-2e63-425e-bf4b-cbc7244aa757 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:56:b8:ff:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:56:b8:ff:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:e9:dc:e3:e4:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.735790    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.735865    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.737497    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.738513    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.738546    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 16:50:40.166567 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.739329    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.739340    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.739348    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.740066    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.741860    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744500    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744613    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744642    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744652    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744667    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744677    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.744687    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.745068    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.745100    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.749693    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.751968    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.751996    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752158    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752172    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752178    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752184    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752192    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752197    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752790    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752797    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752806    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752811    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752820    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.752828    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.753606    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.753613    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.757123    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.757185    2570 server.go:1268] "Started kubelet"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.757410    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.757704    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.757777    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.757770    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.757970    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.763695    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 16:50:40.166844 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.764945    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.765601    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.767608    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.767624    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.767723    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768167    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768182    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768203    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768461    2570 factory.go:55] Registering systemd factory
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768478    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768683    2570 factory.go:153] Registering CRI-O factory
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768696    2570 factory.go:223] Registration of the crio container factory successfully
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768747    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768772    2570 factory.go:103] Registering Raw factory
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768788    2570 manager.go:1196] Started watching for new ooms in manager
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768814    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.768829    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.769195    2570 manager.go:349] Starting recovery of all containers
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.768173    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c0ad28007c32db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-07-09 16:50:39.757152987 +0000 UTC m=+0.352539153,LastTimestamp:2026-07-09 16:50:39.757152987 +0000 UTC m=+0.352539153,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.775530    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.775588    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.778796    2570 manager.go:354] Recovery completed
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.783537    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.786123    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cl26q"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.786584    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.786614    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.786628    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.787220    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.787233    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.787269    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.787272    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788005    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788034    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.167883 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788047    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788923    2570 policy_none.go:49] "None policy: Start"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788936    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.788947    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.789282    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c0ad28023d84e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-07-09 16:50:39.786599651 +0000 UTC m=+0.381985823,LastTimestamp:2026-07-09 16:50:39.786599651 +0000 UTC m=+0.381985823,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.789964    2570 policy_none.go:47] "Start"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.793159    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cl26q"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.853627    2570 manager.go:337] "Starting Device Plugin manager"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.853668    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.853679    2570 server.go:87] "Starting device plugin registration server"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.853984    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.854000    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.854084    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.854187    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.854196    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.854723    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.854780    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.919244    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.920497    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.920544    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.920577    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.920620    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.922708    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.954702    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.955834    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.955863    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.955875    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.955919    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:39.967502    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.967525    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-121.ec2.internal\": node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:39.992107    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.021334    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"]
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.021423    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.168770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.023629    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.023662    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.023676    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.024999    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025164    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025822    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025853    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025860    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025866    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025877    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.025887    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.027092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.027112    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.027836    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.027866    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.027880    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.051719    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.057118    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.070820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.070847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.070865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0f19aeb089e708583fd55e8921a86f8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e0f19aeb089e708583fd55e8921a86f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.169666 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.092769    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0f19aeb089e708583fd55e8921a86f8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e0f19aeb089e708583fd55e8921a86f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0f19aeb089e708583fd55e8921a86f8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e0f19aeb089e708583fd55e8921a86f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.171453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/230be76767beb998e07b7a5d6da29f0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"230be76767beb998e07b7a5d6da29f0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.193459    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.309108 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.294258    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.428148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.353447    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.428148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.360312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:40.428148 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.394947    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.546198 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.495455    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.668802 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:40.595889    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:40.668802 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:40.602877    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:42.044175 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:41.958417    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found"
Jul 09 16:50:42.044175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:41.966572    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 16:50:42.044175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:41.966745    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 16:50:42.044175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:41.966760    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 16:50:42.044175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.033471    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:42.059417 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.058546    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:45:41 +0000 UTC" deadline="2028-04-21 15:40:05.719469912 +0000 UTC"
Jul 09 16:50:42.059417 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.058583    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15646h49m23.660890064s"
Jul 09 16:50:42.161300 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.130043    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:42.161300 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.137708    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 16:50:42.161300 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.138626    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal"
Jul 09 16:50:42.161300 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.149534    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 16:50:42.274989 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:42.260634    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:43.010600 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.008476    2570 apiserver.go:52] "Watching apiserver"
Jul 09 16:50:43.018379 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.017053    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 16:50:43.018379 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.017931    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wzhlk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm","openshift-cluster-node-tuning-operator/tuned-tnmhw","openshift-dns/node-resolver-7vll5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","openshift-multus/multus-fttrq","openshift-multus/network-metrics-daemon-82qqg","openshift-network-operator/iptables-alerter-722bb","kube-system/global-pull-secret-syncer-tn6kw","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal","openshift-image-registry/node-ca-td7lj","openshift-multus/multus-additional-cni-plugins-8fplk","openshift-network-diagnostics/network-check-target-fgfm2","openshift-ovn-kubernetes/ovnkube-node-pxvbt"]
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.020565    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.020643    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.022212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.023677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.024973    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.024973    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.025049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zgc9k\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.025066    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.026271    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.026288    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.026318    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-std9r\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.026348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.027643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.028454    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.028735    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v4lql\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.028768    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.028949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.029961    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.029994    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mj768\""
Jul 09 16:50:43.030075 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.030081    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 16:50:43.031041 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.030233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.031041 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.030295    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:43.031041 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.030388    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 16:50:43.031041 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.030428    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.031180    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.031501    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.031563    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032009    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032026    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032034    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032011    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032397    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032422    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032397    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4wjld\""
Jul 09 16:50:43.033746 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.032624    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.034641 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.033892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.034896    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.034916    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.034967    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.034999    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m52f8\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.035183    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.035966    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhc62\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.036153    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.036340    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.036341    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.036376    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.037188    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.037841    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.038333    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p9d9q\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.038561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ctw2t\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.038562    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.038924    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041823    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-systemd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041880    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwl6\" (UniqueName: \"kubernetes.io/projected/d0e542bd-1a0a-496f-a18a-187ed35a75ed-kube-api-access-xhwl6\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-systemd-units\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-conf-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-tmp\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.139032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465f24b0-84be-4cc7-822b-313c33b37a3f-tmp-dir\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.041958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-netd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042081    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6998544-d4eb-4286-9185-92be919467de-host\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-node-log\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-config\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8zrb\" (UniqueName: \"kubernetes.io/projected/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-kube-api-access-w8zrb\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-socket-dir-parent\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-hostroot\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovn-node-metrics-cert\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-system-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-multus\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.142717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-systemd\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-var-lib-kubelet\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-os-release\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-cni-binary-copy\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-run\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-slash\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-log-socket\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-env-overrides\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-script-lib\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-multus-certs\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-kubelet-config\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-netns\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.143565 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysconfig\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-sys\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc748\" (UniqueName: \"kubernetes.io/projected/a6998544-d4eb-4286-9185-92be919467de-kube-api-access-qc748\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042869    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-netns\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042894    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4mp\" (UniqueName: \"kubernetes.io/projected/a19a1821-8f5f-4296-85b9-4327934b8c3e-kube-api-access-rd4mp\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042915    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-lib-modules\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-tuned\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-bin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.042990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-daemon-config\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrw9\" (UniqueName: \"kubernetes.io/projected/3b703ef6-819e-4f10-8e6e-bcbd45aea824-kube-api-access-rjrw9\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-bin\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-k8s-cni-cncf-io\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-var-lib-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/465f24b0-84be-4cc7-822b-313c33b37a3f-hosts-file\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.253426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-etc-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-kubelet\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-etc-kubernetes\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-dbus\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-kubernetes\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-conf\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-ovn\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-host\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsd7v\" (UniqueName: \"kubernetes.io/projected/465f24b0-84be-4cc7-822b-313c33b37a3f-kube-api-access-qsd7v\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-modprobe-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6998544-d4eb-4286-9185-92be919467de-serviceca\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-kubelet\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254288 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.043434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-cnibin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.045867    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.066297    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-47dss"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.072081    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-47dss"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.130561    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.141274    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-slash\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-log-socket\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-env-overrides\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144202    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-script-lib\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144217    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-multus-certs\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144233    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-kubelet-config\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-log-socket\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-slash\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-kubelet-config\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-registration-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-multus-certs\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.254707 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-netns\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysconfig\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-sys\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-netns\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-iptables-alerter-script\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysconfig\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc748\" (UniqueName: \"kubernetes.io/projected/a6998544-d4eb-4286-9185-92be919467de-kube-api-access-qc748\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144616    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-netns\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144638    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-sys\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4mp\" (UniqueName: \"kubernetes.io/projected/a19a1821-8f5f-4296-85b9-4327934b8c3e-kube-api-access-rd4mp\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-netns\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-lib-modules\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-tuned\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256344 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-bin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144811    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-bin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-daemon-config\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144853    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-lib-modules\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-etc-selinux\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-system-cni-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-cnibin\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrw9\" (UniqueName: \"kubernetes.io/projected/3b703ef6-819e-4f10-8e6e-bcbd45aea824-kube-api-access-rjrw9\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-bin\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.144989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-k8s-cni-cncf-io\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-socket-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145030    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-host-slash\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.256809 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-bin\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145078    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-run-k8s-cni-cncf-io\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-var-lib-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-var-lib-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/465f24b0-84be-4cc7-822b-313c33b37a3f-hosts-file\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-etc-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/465f24b0-84be-4cc7-822b-313c33b37a3f-hosts-file\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145225    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-kubelet\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-etc-kubernetes\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-kubelet\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-dbus\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-etc-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.258066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-kubernetes\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-dbus\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-etc-kubernetes\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-conf\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-kubernetes\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45977ed8-0d0c-4b0b-b024-ceeceb147241-agent-certs\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-ovn\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145473    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-host\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-ovn\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsd7v\" (UniqueName: \"kubernetes.io/projected/465f24b0-84be-4cc7-822b-313c33b37a3f-kube-api-access-qsd7v\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-modprobe-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6998544-d4eb-4286-9185-92be919467de-serviceca\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-kubelet\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145570    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-conf\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.259062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-cnibin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-host\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-systemd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwl6\" (UniqueName: \"kubernetes.io/projected/d0e542bd-1a0a-496f-a18a-187ed35a75ed-kube-api-access-xhwl6\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-cnibin\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-sys-fs\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145678    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-systemd-units\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.145701    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-conf-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-tmp\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.260127 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwrk\" (UniqueName: \"kubernetes.io/projected/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-kube-api-access-kwwrk\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.145787    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:43.64576834 +0000 UTC m=+2.979229432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-systemd-units\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-kubelet\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-conf-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145903    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-systemd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145984    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-modprobe-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.145804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465f24b0-84be-4cc7-822b-313c33b37a3f-tmp-dir\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-netd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-cni-netd\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.262197 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb926\" (UniqueName: \"kubernetes.io/projected/eee496b5-ee2d-4b49-8395-063901851612-kube-api-access-wb926\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146129    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6998544-d4eb-4286-9185-92be919467de-host\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-node-log\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.146193    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-config\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146225    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8zrb\" (UniqueName: \"kubernetes.io/projected/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-kube-api-access-w8zrb\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.146243    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:50:43.646228129 +0000 UTC m=+2.979689220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6998544-d4eb-4286-9185-92be919467de-host\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-socket-dir-parent\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-hostroot\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-socket-dir-parent\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146336    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-hostroot\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njx7g\" (UniqueName: \"kubernetes.io/projected/8e809fe9-00b1-4e38-b098-d3baadc77224-kube-api-access-njx7g\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.262579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-node-log\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovn-node-metrics-cert\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-system-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-multus\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-systemd\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-var-lib-kubelet\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45977ed8-0d0c-4b0b-b024-ceeceb147241-konnectivity-ca\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146581    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-os-release\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-os-release\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-systemd\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-cni-binary-copy\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-run\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-device-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.262996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-system-cni-dir\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-host-var-lib-cni-multus\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-run\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146935    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-sysctl-d\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0e542bd-1a0a-496f-a18a-187ed35a75ed-var-lib-kubelet\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.146998    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-run-openvswitch\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.147060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a19a1821-8f5f-4296-85b9-4327934b8c3e-os-release\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.148626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6998544-d4eb-4286-9185-92be919467de-serviceca\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.148773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-script-lib\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.148787    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovnkube-config\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.148950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/465f24b0-84be-4cc7-822b-313c33b37a3f-tmp-dir\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.149104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-env-overrides\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.149192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-etc-tuned\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.149246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0e542bd-1a0a-496f-a18a-187ed35a75ed-tmp\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.150087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-cni-binary-copy\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263386 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.150148    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a19a1821-8f5f-4296-85b9-4327934b8c3e-multus-daemon-config\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.150643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-ovn-node-metrics-cert\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.152993    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.153014    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.153027    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.153077    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:50:43.653061345 +0000 UTC m=+2.986522438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.153754    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4mp\" (UniqueName: \"kubernetes.io/projected/a19a1821-8f5f-4296-85b9-4327934b8c3e-kube-api-access-rd4mp\") pod \"multus-fttrq\" (UID: \"a19a1821-8f5f-4296-85b9-4327934b8c3e\") " pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.154632    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc748\" (UniqueName: \"kubernetes.io/projected/a6998544-d4eb-4286-9185-92be919467de-kube-api-access-qc748\") pod \"node-ca-td7lj\" (UID: \"a6998544-d4eb-4286-9185-92be919467de\") " pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.154847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwl6\" (UniqueName: \"kubernetes.io/projected/d0e542bd-1a0a-496f-a18a-187ed35a75ed-kube-api-access-xhwl6\") pod \"tuned-tnmhw\" (UID: \"d0e542bd-1a0a-496f-a18a-187ed35a75ed\") " pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.155014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrw9\" (UniqueName: \"kubernetes.io/projected/3b703ef6-819e-4f10-8e6e-bcbd45aea824-kube-api-access-rjrw9\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.155104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsd7v\" (UniqueName: \"kubernetes.io/projected/465f24b0-84be-4cc7-822b-313c33b37a3f-kube-api-access-qsd7v\") pod \"node-resolver-7vll5\" (UID: \"465f24b0-84be-4cc7-822b-313c33b37a3f\") " pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.155700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8zrb\" (UniqueName: \"kubernetes.io/projected/74211e9a-523b-4ee3-aa82-30e0ecac0b5b-kube-api-access-w8zrb\") pod \"ovnkube-node-pxvbt\" (UID: \"74211e9a-523b-4ee3-aa82-30e0ecac0b5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwrk\" (UniqueName: \"kubernetes.io/projected/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-kube-api-access-kwwrk\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb926\" (UniqueName: \"kubernetes.io/projected/eee496b5-ee2d-4b49-8395-063901851612-kube-api-access-wb926\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.263760 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njx7g\" (UniqueName: \"kubernetes.io/projected/8e809fe9-00b1-4e38-b098-d3baadc77224-kube-api-access-njx7g\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45977ed8-0d0c-4b0b-b024-ceeceb147241-konnectivity-ca\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-os-release\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-os-release\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-device-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-device-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247479    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-registration-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-registration-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247737    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45977ed8-0d0c-4b0b-b024-ceeceb147241-konnectivity-ca\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-iptables-alerter-script\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-etc-selinux\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-system-cni-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264133 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-cnibin\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-socket-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-host-slash\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-system-cni-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247957    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-etc-selinux\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247981    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-host-slash\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.247999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-cnibin\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eee496b5-ee2d-4b49-8395-063901851612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45977ed8-0d0c-4b0b-b024-ceeceb147241-agent-certs\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-socket-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-sys-fs\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248212    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e809fe9-00b1-4e38-b098-d3baadc77224-sys-fs\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-iptables-alerter-script\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248520    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.248574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eee496b5-ee2d-4b49-8395-063901851612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.250472    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45977ed8-0d0c-4b0b-b024-ceeceb147241-agent-certs\") pod \"konnectivity-agent-wzhlk\" (UID: \"45977ed8-0d0c-4b0b-b024-ceeceb147241\") " pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.259251    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwrk\" (UniqueName: \"kubernetes.io/projected/e7994075-cfaf-4fb3-a2cd-41690e55d0a7-kube-api-access-kwwrk\") pod \"iptables-alerter-722bb\" (UID: \"e7994075-cfaf-4fb3-a2cd-41690e55d0a7\") " pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.259942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb926\" (UniqueName: \"kubernetes.io/projected/eee496b5-ee2d-4b49-8395-063901851612-kube-api-access-wb926\") pod \"multus-additional-cni-plugins-8fplk\" (UID: \"eee496b5-ee2d-4b49-8395-063901851612\") " pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.264866 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.260618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njx7g\" (UniqueName: \"kubernetes.io/projected/8e809fe9-00b1-4e38-b098-d3baadc77224-kube-api-access-njx7g\") pod \"aws-ebs-csi-driver-node-28mbm\" (UID: \"8e809fe9-00b1-4e38-b098-d3baadc77224\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.380478 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.380450    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-td7lj"
Jul 09 16:50:43.401488 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.401455    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnmhw"
Jul 09 16:50:43.418303 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.418282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vll5"
Jul 09 16:50:43.429428 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.429411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:50:43.440381 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.440363    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fttrq"
Jul 09 16:50:43.454526 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.454508    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm"
Jul 09 16:50:43.476012 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.475987    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-722bb"
Jul 09 16:50:43.496428 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.496410    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:50:43.501345 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.501330    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8fplk"
Jul 09 16:50:43.652568 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.652537    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:43.652722 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.652583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:43.652722 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.652682    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:43.652722 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.652685    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:43.652848 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.652734    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:50:44.652720287 +0000 UTC m=+3.986181378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:43.652848 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.652754    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:44.652740019 +0000 UTC m=+3.986201111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:43.753878 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.753799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:43.754053 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.753951    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:43.754053 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.753971    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:43.754053 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.753980    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:43.754053 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.754032    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:50:44.754019425 +0000 UTC m=+4.087480517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:43.859865 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.859812    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6998544_d4eb_4286_9185_92be919467de.slice/crio-d8bc8670adbd34c18bf48e1ec81742110bb918a917b71c89f92f4fa350ce9c8c WatchSource:0}: Error finding container d8bc8670adbd34c18bf48e1ec81742110bb918a917b71c89f92f4fa350ce9c8c: Status 404 returned error can't find the container with id d8bc8670adbd34c18bf48e1ec81742110bb918a917b71c89f92f4fa350ce9c8c
Jul 09 16:50:43.860400 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.860381    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230be76767beb998e07b7a5d6da29f0e.slice/crio-9c57c3401b480dd5820af90e62ce9adeea9fd671d70943d734df83027d453ec3 WatchSource:0}: Error finding container 9c57c3401b480dd5820af90e62ce9adeea9fd671d70943d734df83027d453ec3: Status 404 returned error can't find the container with id 9c57c3401b480dd5820af90e62ce9adeea9fd671d70943d734df83027d453ec3
Jul 09 16:50:43.861137 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.861120    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74211e9a_523b_4ee3_aa82_30e0ecac0b5b.slice/crio-2c256a144c94942e2b56c342d9c1629691bc6e69f72f3614a3816dfd4d636c01 WatchSource:0}: Error finding container 2c256a144c94942e2b56c342d9c1629691bc6e69f72f3614a3816dfd4d636c01: Status 404 returned error can't find the container with id 2c256a144c94942e2b56c342d9c1629691bc6e69f72f3614a3816dfd4d636c01
Jul 09 16:50:43.862374 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.862354    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f19aeb089e708583fd55e8921a86f8.slice/crio-64e24c1eae70aabfa2e6e464fd9e0f3d47cfb119a69c1b4c50e455741d51111a WatchSource:0}: Error finding container 64e24c1eae70aabfa2e6e464fd9e0f3d47cfb119a69c1b4c50e455741d51111a: Status 404 returned error can't find the container with id 64e24c1eae70aabfa2e6e464fd9e0f3d47cfb119a69c1b4c50e455741d51111a
Jul 09 16:50:43.865500 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.865471    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 16:50:43.886037 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.886011    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee496b5_ee2d_4b49_8395_063901851612.slice/crio-289a5c4011f0cadb1cf0e9166f3a8f5bfcfb2d0d86203fc48ae4062c0432713f WatchSource:0}: Error finding container 289a5c4011f0cadb1cf0e9166f3a8f5bfcfb2d0d86203fc48ae4062c0432713f: Status 404 returned error can't find the container with id 289a5c4011f0cadb1cf0e9166f3a8f5bfcfb2d0d86203fc48ae4062c0432713f
Jul 09 16:50:43.933799 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.933766    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7994075_cfaf_4fb3_a2cd_41690e55d0a7.slice/crio-a2985b8a61ffd97cabbe2df08a8952490aa7bfcae639dcf26d339f91b7acc0eb WatchSource:0}: Error finding container a2985b8a61ffd97cabbe2df08a8952490aa7bfcae639dcf26d339f91b7acc0eb: Status 404 returned error can't find the container with id a2985b8a61ffd97cabbe2df08a8952490aa7bfcae639dcf26d339f91b7acc0eb
Jul 09 16:50:43.934391 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.934364    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e809fe9_00b1_4e38_b098_d3baadc77224.slice/crio-5e1e55bc871b2510fee718bbb0bf5e3742af0f55c2ed11b561b9d861e4b59618 WatchSource:0}: Error finding container 5e1e55bc871b2510fee718bbb0bf5e3742af0f55c2ed11b561b9d861e4b59618: Status 404 returned error can't find the container with id 5e1e55bc871b2510fee718bbb0bf5e3742af0f55c2ed11b561b9d861e4b59618
Jul 09 16:50:43.935132 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.935105    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e542bd_1a0a_496f_a18a_187ed35a75ed.slice/crio-17403656d0bf3776a3d42366b09e87de61a801f453178a65cd2373cf8d7dc2f9 WatchSource:0}: Error finding container 17403656d0bf3776a3d42366b09e87de61a801f453178a65cd2373cf8d7dc2f9: Status 404 returned error can't find the container with id 17403656d0bf3776a3d42366b09e87de61a801f453178a65cd2373cf8d7dc2f9
Jul 09 16:50:43.953089 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:43.953069    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 16:50:43.971444 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.971422    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19a1821_8f5f_4296_85b9_4327934b8c3e.slice/crio-38f17afdb1d774cdb0718b594334ea3ed6fdce75ba0a94e05fb754dabca8ba94 WatchSource:0}: Error finding container 38f17afdb1d774cdb0718b594334ea3ed6fdce75ba0a94e05fb754dabca8ba94: Status 404 returned error can't find the container with id 38f17afdb1d774cdb0718b594334ea3ed6fdce75ba0a94e05fb754dabca8ba94
Jul 09 16:50:43.971858 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.971839    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45977ed8_0d0c_4b0b_b024_ceeceb147241.slice/crio-84e46f8022309c043fa1744afb6fb415863eabe0e9058744f26e7e2a24b3b762 WatchSource:0}: Error finding container 84e46f8022309c043fa1744afb6fb415863eabe0e9058744f26e7e2a24b3b762: Status 404 returned error can't find the container with id 84e46f8022309c043fa1744afb6fb415863eabe0e9058744f26e7e2a24b3b762
Jul 09 16:50:43.989778 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:50:43.989756    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465f24b0_84be_4cc7_822b_313c33b37a3f.slice/crio-07d571296f950126a2c374269cc005144b141a85a55562ef73a2d27d6379b73f WatchSource:0}: Error finding container 07d571296f950126a2c374269cc005144b141a85a55562ef73a2d27d6379b73f: Status 404 returned error can't find the container with id 07d571296f950126a2c374269cc005144b141a85a55562ef73a2d27d6379b73f
Jul 09 16:50:43.991350 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.991331    2570 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-7vll5_openshift-dns(465f24b0-84be-4cc7-822b-313c33b37a3f): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 09 16:50:43.991421 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:43.991362    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-7vll5" podUID="465f24b0-84be-4cc7-822b-313c33b37a3f"
Jul 09 16:50:44.074028 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.073955    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:45:43 +0000 UTC" deadline="2027-12-12 03:06:49.053290595 +0000 UTC"
Jul 09 16:50:44.074028 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.074018    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12490h16m4.979274936s"
Jul 09 16:50:44.316092 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.315984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"2c256a144c94942e2b56c342d9c1629691bc6e69f72f3614a3816dfd4d636c01"}
Jul 09 16:50:44.318119 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.318087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"230be76767beb998e07b7a5d6da29f0e","Type":"ContainerStarted","Data":"9c57c3401b480dd5820af90e62ce9adeea9fd671d70943d734df83027d453ec3"}
Jul 09 16:50:44.319612 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.319586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vll5" event={"ID":"465f24b0-84be-4cc7-822b-313c33b37a3f","Type":"ContainerStarted","Data":"07d571296f950126a2c374269cc005144b141a85a55562ef73a2d27d6379b73f"}
Jul 09 16:50:44.321255 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.321198    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-7vll5" podUID="465f24b0-84be-4cc7-822b-313c33b37a3f"
Jul 09 16:50:44.321611 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.321583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fttrq" event={"ID":"a19a1821-8f5f-4296-85b9-4327934b8c3e","Type":"ContainerStarted","Data":"38f17afdb1d774cdb0718b594334ea3ed6fdce75ba0a94e05fb754dabca8ba94"}
Jul 09 16:50:44.323118 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.323071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnmhw" event={"ID":"d0e542bd-1a0a-496f-a18a-187ed35a75ed","Type":"ContainerStarted","Data":"17403656d0bf3776a3d42366b09e87de61a801f453178a65cd2373cf8d7dc2f9"}
Jul 09 16:50:44.325418 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.325395    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-722bb" event={"ID":"e7994075-cfaf-4fb3-a2cd-41690e55d0a7","Type":"ContainerStarted","Data":"a2985b8a61ffd97cabbe2df08a8952490aa7bfcae639dcf26d339f91b7acc0eb"}
Jul 09 16:50:44.326742 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.326710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerStarted","Data":"289a5c4011f0cadb1cf0e9166f3a8f5bfcfb2d0d86203fc48ae4062c0432713f"}
Jul 09 16:50:44.328143 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.328112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wzhlk" event={"ID":"45977ed8-0d0c-4b0b-b024-ceeceb147241","Type":"ContainerStarted","Data":"84e46f8022309c043fa1744afb6fb415863eabe0e9058744f26e7e2a24b3b762"}
Jul 09 16:50:44.329477 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.329455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm" event={"ID":"8e809fe9-00b1-4e38-b098-d3baadc77224","Type":"ContainerStarted","Data":"5e1e55bc871b2510fee718bbb0bf5e3742af0f55c2ed11b561b9d861e4b59618"}
Jul 09 16:50:44.330742 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.330709    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-td7lj" event={"ID":"a6998544-d4eb-4286-9185-92be919467de","Type":"ContainerStarted","Data":"d8bc8670adbd34c18bf48e1ec81742110bb918a917b71c89f92f4fa350ce9c8c"}
Jul 09 16:50:44.331960 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.331931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"e0f19aeb089e708583fd55e8921a86f8","Type":"ContainerStarted","Data":"64e24c1eae70aabfa2e6e464fd9e0f3d47cfb119a69c1b4c50e455741d51111a"}
Jul 09 16:50:44.332059 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.331957    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:44.332117 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.332077    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:44.659729 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.659689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:44.659930 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.659763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:44.659999 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.659964    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:44.660060 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.660030    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:46.660010697 +0000 UTC m=+5.993471796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:44.660481 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.660462    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:44.660554 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.660524    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:50:46.660507223 +0000 UTC m=+5.993968315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:44.761200 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:44.760571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:44.761200 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.760749    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:44.761200 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.760770    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:44.761200 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.760783    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:44.761200 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:44.760850    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:50:46.760819115 +0000 UTC m=+6.094280211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:45.074241 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:45.074129    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:45:43 +0000 UTC" deadline="2028-01-16 05:34:27.350726699 +0000 UTC"
Jul 09 16:50:45.074241 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:45.074191    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13332h43m42.276539582s"
Jul 09 16:50:45.186017 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:45.185990    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:45.186193 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:45.186123    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:45.186504 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:45.186486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:45.186594 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:45.186576    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:46.183438 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:46.183409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:46.183998 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.183517    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:46.675772 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:46.675734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:46.675973 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:46.675805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:46.675973 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.675914    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:46.676089 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.675977    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:50.675963471 +0000 UTC m=+10.009424563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:46.676089 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.675919    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:46.676089 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.676064    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:50:50.676048097 +0000 UTC m=+10.009509195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:46.776735 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:46.776695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:46.776953 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.776905    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:46.776953 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.776928    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:46.776953 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.776940    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:46.777122 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:46.776999    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:50:50.776981061 +0000 UTC m=+10.110442152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:47.183969 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:47.183926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:47.184614 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:47.184072    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:47.186334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:47.186310    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:47.186445 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:47.186424    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:48.183607 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:48.183572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:48.183794 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:48.183708    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:49.183265 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:49.183229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:49.183265 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:49.183262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:49.183728 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:49.183386    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:49.183728 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:49.183465    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:50.183404 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:50.183368    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:50.183856 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.183529    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:50.708402 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:50.708360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:50.708597 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:50.708441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:50.708597 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.708530    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:50.708729 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.708618    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:50.708729 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.708622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:50:58.708603046 +0000 UTC m=+18.042064141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:50.708729 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.708687    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:50:58.708672264 +0000 UTC m=+18.042133358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:50.809761 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:50.809718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:50.809943 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.809923    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:50.810022 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.809953    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:50.810022 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.809967    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:50.810142 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:50.810031    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:50:58.810012041 +0000 UTC m=+18.143473137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:51.188105 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:51.187472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:51.188105 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:51.187580    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:51.188105 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:51.187952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:51.188105 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:51.188056    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:52.183125 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:52.183091    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:52.183313 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:52.183221    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:53.184095 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:53.183632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:53.184095 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:53.183775    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:53.184095 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:53.183854    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:53.184095 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:53.184001    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:54.183526 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:54.183494    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:54.183683 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:54.183610    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:55.183647 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:55.183609    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:55.184106 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:55.183848    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:55.184106 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:55.183947    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:55.184106 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:55.184050    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:56.183499 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:56.183467    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:56.183662 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:56.183578    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:57.183462 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:57.183421    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:57.183956 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:57.183571    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:57.183956 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:57.183635    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:57.183956 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:57.183744    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:50:58.182998 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:58.182952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:58.183188 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.183087    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:50:58.768778 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:58.768739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:58.769195 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:58.768795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:50:58.769195 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.768908    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:58.769195 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.768928    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:58.769195 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.768984    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:51:14.768967237 +0000 UTC m=+34.102428328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:50:58.769195 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.769007    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:14.768996279 +0000 UTC m=+34.102457371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:50:58.869338 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:58.869270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:58.869488 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.869448    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:50:58.869488 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.869470    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:50:58.869488 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.869480    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:58.869585 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:58.869530    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:51:14.869516398 +0000 UTC m=+34.202977490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:50:59.182711 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:59.182676    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:50:59.182861 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:50:59.182676    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:50:59.182861 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:59.182791    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:50:59.182951 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:50:59.182862    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:00.182906 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:00.182868    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:00.183355 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:00.183013    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:01.183915 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:01.183816    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:01.184342 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:01.183963    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:01.184342 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:01.184028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:01.184342 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:01.184149    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:02.183296 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:02.183260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:02.183466 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:02.183384    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:03.183050 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:03.183005    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:03.183488 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:03.183006    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:03.183488 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:03.183132    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:03.183488 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:03.183207    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:04.185682 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.184668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:04.185682 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:04.184998    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:04.378744 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.378717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnmhw" event={"ID":"d0e542bd-1a0a-496f-a18a-187ed35a75ed","Type":"ContainerStarted","Data":"3ba81383ff5c66474559b9b27a4b2436283bae02ded99e800e6f70d880164e58"}
Jul 09 16:51:04.380099 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.380070    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"e0f19aeb089e708583fd55e8921a86f8","Type":"ContainerStarted","Data":"1c0bfc7d181b0ce7b87b05e2245f2af4b92c115bb4f35d055482d99cd0a2737b"}
Jul 09 16:51:04.381998 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.381975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"21725caf9bb34d6c0fd3490ec3721dc68639254c765dda7cc1a6080fb36cd472"}
Jul 09 16:51:04.382087 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.382049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"7ed3417add09d8bee7f46faa6ab1b51bfb599d99c31f8e9274a0d575bfa782ad"}
Jul 09 16:51:04.382147 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.382096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"e7e5aee46d2d0a0898c0493122264f5bf0fa2f85e7005ae023e5787e7b575fc7"}
Jul 09 16:51:04.383400 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.383371    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fttrq" event={"ID":"a19a1821-8f5f-4296-85b9-4327934b8c3e","Type":"ContainerStarted","Data":"e01dc70239af940aad426a03cfcabb2dbc4fe5a52cea985657f9f30f6866ef91"}
Jul 09 16:51:04.396167 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.396113    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnmhw" podStartSLOduration=3.893231658 podStartE2EDuration="23.396095498s" totalImagesPullingTime="19.50286384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:04.395026216 +0000 UTC m=+23.728487332" watchObservedRunningTime="2026-07-09 16:51:04.396095498 +0000 UTC m=+23.729556613"
Jul 09 16:51:04.413032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.412988    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fttrq" podStartSLOduration=3.9203030610000003 podStartE2EDuration="23.412971426s" totalImagesPullingTime="19.492668365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:04.41295449 +0000 UTC m=+23.746415604" watchObservedRunningTime="2026-07-09 16:51:04.412971426 +0000 UTC m=+23.746432520"
Jul 09 16:51:04.442315 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:04.442270    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" podStartSLOduration=22.442252564 podStartE2EDuration="22.442252564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:04.442236967 +0000 UTC m=+23.775698082" watchObservedRunningTime="2026-07-09 16:51:04.442252564 +0000 UTC m=+23.775713678"
Jul 09 16:51:05.182821 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.182783    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:05.182998 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:05.182943    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:05.183068 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.183001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:05.183134 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:05.183113    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:05.387261 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.387230    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="fc722c82dec62cdc81c8abc967f73288cabc25387cdec81f28b672395e0ec099" exitCode=0
Jul 09 16:51:05.388077 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.387318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"fc722c82dec62cdc81c8abc967f73288cabc25387cdec81f28b672395e0ec099"}
Jul 09 16:51:05.389001 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.388916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wzhlk" event={"ID":"45977ed8-0d0c-4b0b-b024-ceeceb147241","Type":"ContainerStarted","Data":"8c46ed1687abb6db3ce1fd1f5dbe58aa1516faf5ce6ebe7d643b4cddfaa57ae4"}
Jul 09 16:51:05.390595 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.390565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm" event={"ID":"8e809fe9-00b1-4e38-b098-d3baadc77224","Type":"ContainerStarted","Data":"405db9457c09c4a23e9d3e2f87a09bc498bd58935ff1afc69837082460f590c2"}
Jul 09 16:51:05.392625 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.392601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-td7lj" event={"ID":"a6998544-d4eb-4286-9185-92be919467de","Type":"ContainerStarted","Data":"d1e286dbb93423bef4883dda2fa919e07137ddd50d5453f9380555c4c84f0543"}
Jul 09 16:51:05.395944 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.395920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"aa2d9c8530820e9a84099fc0bf35686a171952218ebf5e07d0b1e4dc14f59e04"}
Jul 09 16:51:05.396058 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.395997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"43ba73d61ce2e81cc801efb10f33006a5176c487bd3bd5aa79f4d79b63c80239"}
Jul 09 16:51:05.396058 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.396048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"1980e82f38d28319e7502bdac942e89e6984e3297b64b1be26444a70c1f451dc"}
Jul 09 16:51:05.397522 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.397500    2570 generic.go:356] "Generic (PLEG): container finished" podID="230be76767beb998e07b7a5d6da29f0e" containerID="2ecb6370aec42041f97d2bb7fe1e37a9b171662b4b1029a039bdad2a5668bf33" exitCode=0
Jul 09 16:51:05.397630 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.397587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"230be76767beb998e07b7a5d6da29f0e","Type":"ContainerDied","Data":"2ecb6370aec42041f97d2bb7fe1e37a9b171662b4b1029a039bdad2a5668bf33"}
Jul 09 16:51:05.399539 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.399154    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vll5" event={"ID":"465f24b0-84be-4cc7-822b-313c33b37a3f","Type":"ContainerStarted","Data":"d5944796ed7f65774c9bf6ec8daa1d21c0bdd7e422a16fdbde5bbe767be08015"}
Jul 09 16:51:05.400759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.400678    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-722bb" event={"ID":"e7994075-cfaf-4fb3-a2cd-41690e55d0a7","Type":"ContainerStarted","Data":"b9ae43d9cc33668713d3ec852b3055ad725886b2ba71401ea743ce6bf542f63f"}
Jul 09 16:51:05.428154 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.428108    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-722bb" podStartSLOduration=4.926976052 podStartE2EDuration="24.428089847s" totalImagesPullingTime="19.501113795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:05.427775984 +0000 UTC m=+24.761237098" watchObservedRunningTime="2026-07-09 16:51:05.428089847 +0000 UTC m=+24.761550964"
Jul 09 16:51:05.444113 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.444068    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-td7lj" podStartSLOduration=4.925190002 podStartE2EDuration="24.444048645s" totalImagesPullingTime="19.518858643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:05.444024105 +0000 UTC m=+24.777485220" watchObservedRunningTime="2026-07-09 16:51:05.444048645 +0000 UTC m=+24.777509760"
Jul 09 16:51:05.458852 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.458795    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7vll5" podStartSLOduration=4.778836625 podStartE2EDuration="24.458778709s" totalImagesPullingTime="19.679942084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 16:51:05.458615538 +0000 UTC m=+24.792076652" watchObservedRunningTime="2026-07-09 16:51:05.458778709 +0000 UTC m=+24.792239823"
Jul 09 16:51:05.478887 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:05.478755    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wzhlk" podStartSLOduration=5.022027332 podStartE2EDuration="24.478734906s" totalImagesPullingTime="19.456707574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:05.478478319 +0000 UTC m=+24.811939451" watchObservedRunningTime="2026-07-09 16:51:05.478734906 +0000 UTC m=+24.812196193"
Jul 09 16:51:06.141889 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.141867    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 16:51:06.182742 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.182719    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:06.182883 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:06.182815    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:06.232540 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.232464    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:51:06.233079 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.233062    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:51:06.405574 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.405513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm" event={"ID":"8e809fe9-00b1-4e38-b098-d3baadc77224","Type":"ContainerStarted","Data":"1975e59d03f42b3e8eaadf3eda5f87d250e5e53c3725621f03cad25bdeb5e8b2"}
Jul 09 16:51:06.407553 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.407520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"230be76767beb998e07b7a5d6da29f0e","Type":"ContainerStarted","Data":"fb5ce66161affdf96f95d4c5ab31171a3d439b37fac5a0971f6ce71f77a71551"}
Jul 09 16:51:06.422581 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:06.422493    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" podStartSLOduration=24.422471638 podStartE2EDuration="24.422471638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:06.422139593 +0000 UTC m=+25.755600706" watchObservedRunningTime="2026-07-09 16:51:06.422471638 +0000 UTC m=+25.755932753"
Jul 09 16:51:07.130512 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.130430    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:51:06.141885121Z","UUID":"ceb6e572-abb4-4145-916e-36b018f32a36","Handler":null,"Name":"","Endpoint":""}
Jul 09 16:51:07.133213 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.133190    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 16:51:07.133349 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.133231    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 16:51:07.182773 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.182742    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:07.182964 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:07.182890    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:07.182964 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.182915    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:07.183083 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:07.183046    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:07.414326 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.414244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"b2a27fe58acad8d6f1f837eb78433d58989809ebd4253ac49530fe6c7afd6dae"}
Jul 09 16:51:07.414803 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.414256    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 16:51:07.665732 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.665667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:51:07.666436 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:07.666389    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wzhlk"
Jul 09 16:51:08.183085 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:08.183054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:08.183244 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:08.183165    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:08.418207 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:08.418172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm" event={"ID":"8e809fe9-00b1-4e38-b098-d3baadc77224","Type":"ContainerStarted","Data":"a72faef971c292e40a1edd80b5aeec968f9ce04a9d3b18435750f9ccf4499937"}
Jul 09 16:51:08.439414 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:08.439331    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28mbm" podStartSLOduration=4.339870631 podStartE2EDuration="27.439314869s" totalImagesPullingTime="23.099444238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:08.438176581 +0000 UTC m=+27.771637694" watchObservedRunningTime="2026-07-09 16:51:08.439314869 +0000 UTC m=+27.772775965"
Jul 09 16:51:09.187441 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:09.187303    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:09.187599 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:09.187300    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:09.187599 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:09.187533    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:09.187599 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:09.187582    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:09.425244 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:09.425207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" event={"ID":"74211e9a-523b-4ee3-aa82-30e0ecac0b5b","Type":"ContainerStarted","Data":"2b7fed1ead016e13cde43847739bc1b9ce59c18149d13d35fcbe2a831a05a05c"}
Jul 09 16:51:09.452100 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:09.452044    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt" podStartSLOduration=8.370693163 podStartE2EDuration="28.452024404s" totalImagesPullingTime="20.081331241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:09.451059294 +0000 UTC m=+28.784520436" watchObservedRunningTime="2026-07-09 16:51:09.452024404 +0000 UTC m=+28.785485522"
Jul 09 16:51:10.183319 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.183284    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:10.183472 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:10.183419    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:10.428091 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.427981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:10.428091 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.428082    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:10.428689 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.428131    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:10.445536 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.445450    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:10.445687 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:10.445567    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:11.186244 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.186212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:11.186447 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.186211    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:11.186447 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:11.186337    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:11.186582 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:11.186437    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:11.323457 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.323424    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn6kw"]
Jul 09 16:51:11.323617 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.323552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:11.323700 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:11.323659    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:11.326596 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.326565    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82qqg"]
Jul 09 16:51:11.327429 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.327405    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgfm2"]
Jul 09 16:51:11.429885 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.429856    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:11.430357 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:11.429856    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:11.430357 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:11.430055    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:11.430635 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:11.430601    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:12.434549 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:12.434522    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="6990ab2b137c06ba74284fa27055948f65dd9a00e40b4def7f5b9d212f198160" exitCode=0
Jul 09 16:51:12.434952 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:12.434597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"6990ab2b137c06ba74284fa27055948f65dd9a00e40b4def7f5b9d212f198160"}
Jul 09 16:51:13.182759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:13.182715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:13.182759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:13.182756    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:13.182958 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:13.182756    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:13.182958 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:13.182891    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:13.183037 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:13.182998    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:13.183085 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:13.183066    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:14.440724 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:14.440688    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="16c202e870e0887e722e463f0dd97c89e3f296734b47872c675331a174c2eff4" exitCode=0
Jul 09 16:51:14.441082 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:14.440755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"16c202e870e0887e722e463f0dd97c89e3f296734b47872c675331a174c2eff4"}
Jul 09 16:51:14.785465 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:14.785391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:14.785465 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:14.785434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:14.785630 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.785524    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:14.785630 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.785527    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:14.785630 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.785570    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret podName:205d0beb-7cf0-4dc6-b0a3-854be0c73afa nodeName:}" failed. No retries permitted until 2026-07-09 16:51:46.785557486 +0000 UTC m=+66.119018577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret") pod "global-pull-secret-syncer-tn6kw" (UID: "205d0beb-7cf0-4dc6-b0a3-854be0c73afa") : object "kube-system"/"original-pull-secret" not registered
Jul 09 16:51:14.785630 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.785583    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:46.785577002 +0000 UTC m=+66.119038093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 16:51:14.885986 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:14.885960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:14.886141 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.886121    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 16:51:14.886177 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.886151    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 16:51:14.886177 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.886162    2570 projected.go:196] Error preparing data for projected volume kube-api-access-2l92m for pod openshift-network-diagnostics/network-check-target-fgfm2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:14.886231 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:14.886208    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m podName:9fd1f3fe-a441-4e54-a541-c5e7146ec0fe nodeName:}" failed. No retries permitted until 2026-07-09 16:51:46.88619536 +0000 UTC m=+66.219656456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2l92m" (UniqueName: "kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m") pod "network-check-target-fgfm2" (UID: "9fd1f3fe-a441-4e54-a541-c5e7146ec0fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 16:51:15.186353 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:15.186328    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:15.186523 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:15.186453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:15.186523 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:15.186484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:15.186628 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:15.186555    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qqg" podUID="3b703ef6-819e-4f10-8e6e-bcbd45aea824"
Jul 09 16:51:15.186628 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:15.186455    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tn6kw" podUID="205d0beb-7cf0-4dc6-b0a3-854be0c73afa"
Jul 09 16:51:15.186708 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:15.186658    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgfm2" podUID="9fd1f3fe-a441-4e54-a541-c5e7146ec0fe"
Jul 09 16:51:16.446800 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:16.446633    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="73f724fd0ea669b0ba9f09b1b61670b024dcb90bfbff07191f66413d9f540145" exitCode=0
Jul 09 16:51:16.447161 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:16.446711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"73f724fd0ea669b0ba9f09b1b61670b024dcb90bfbff07191f66413d9f540145"}
Jul 09 16:51:16.995447 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:16.995416    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeReady"
Jul 09 16:51:16.995603 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:16.995550    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 16:51:17.028980 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.028952    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:51:17.045945 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.045920    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5nlhj"]
Jul 09 16:51:17.046064 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.046017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.048617 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.048589    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2wj2f\""
Jul 09 16:51:17.048617 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.048613    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 16:51:17.048763 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.048663    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 16:51:17.048905 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.048892    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 16:51:17.058945 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.058926    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 16:51:17.058945 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.058937    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:51:17.059069 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.058972    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-znlmc"]
Jul 09 16:51:17.059069 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.059046    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.062826 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.062774    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 16:51:17.062993 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.062915    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vwg8\""
Jul 09 16:51:17.063250 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.063133    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 16:51:17.071935 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.071919    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nlhj"]
Jul 09 16:51:17.072035 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.071948    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znlmc"]
Jul 09 16:51:17.072093 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.072037    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.074634 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.074530    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 16:51:17.074725 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.074635    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 16:51:17.074725 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.074673    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h84wl\""
Jul 09 16:51:17.074725 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.074673    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 16:51:17.182813 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.182780    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:17.183013 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.182933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:17.183314 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.183151    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:17.185743 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.185721    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 16:51:17.185884 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.185851    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 16:51:17.185884 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.185870    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2fgzg\""
Jul 09 16:51:17.185997 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.185869    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tqb9\""
Jul 09 16:51:17.185997 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.185978    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 16:51:17.186212 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.186190    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 16:51:17.202448 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202561 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202561 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1403ef1-99fe-4e7f-8193-45884c314367-config-volume\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.202561 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202525    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hgm4\" (UniqueName: \"kubernetes.io/projected/f1403ef1-99fe-4e7f-8193-45884c314367-kube-api-access-6hgm4\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.202705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlx59\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkmtr\" (UniqueName: \"kubernetes.io/projected/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-kube-api-access-kkmtr\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.202705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202879 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202879 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202879 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.202879 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-cert\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.202879 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202857    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.203027 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.202902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1403ef1-99fe-4e7f-8193-45884c314367-tmp-dir\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.303666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.303595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1403ef1-99fe-4e7f-8193-45884c314367-tmp-dir\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.303666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.303630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.303666 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.303661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.303956 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.303759    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:17.303956 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.303775    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:17.303956 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.303790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1403ef1-99fe-4e7f-8193-45884c314367-config-volume\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.304404 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hgm4\" (UniqueName: \"kubernetes.io/projected/f1403ef1-99fe-4e7f-8193-45884c314367-kube-api-access-6hgm4\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.304404 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.304189    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.804149519 +0000 UTC m=+37.137610617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:17.304584 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.304584 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlx59\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.304584 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304528    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1403ef1-99fe-4e7f-8193-45884c314367-tmp-dir\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.304584 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkmtr\" (UniqueName: \"kubernetes.io/projected/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-kube-api-access-kkmtr\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.304811 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.304894 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.304952 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.304886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.305058 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.305036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.305202 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.305185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.305316 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.305221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-cert\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.305365 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.305354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.306013 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.305994    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:17.306104 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.306058    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:17.806040316 +0000 UTC m=+37.139501415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:17.306253 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.306228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.306496 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.306473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1403ef1-99fe-4e7f-8193-45884c314367-config-volume\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.310022 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.309989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.310153 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.310111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-cert\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.310417 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.310396    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.310748 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.310716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.313444 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.313421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkmtr\" (UniqueName: \"kubernetes.io/projected/7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d-kube-api-access-kkmtr\") pod \"ingress-canary-znlmc\" (UID: \"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d\") " pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.313777 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.313753    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.314160 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.314111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlx59\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.314258 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.314234    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hgm4\" (UniqueName: \"kubernetes.io/projected/f1403ef1-99fe-4e7f-8193-45884c314367-kube-api-access-6hgm4\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.381562 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.381524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znlmc"
Jul 09 16:51:17.583007 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.582940    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znlmc"]
Jul 09 16:51:17.589142 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:17.589116    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fab8831_e9d1_4b0f_8b9b_26c8308f8c1d.slice/crio-0027700afb2e05343e311fc5255dd90df7846aca0b146351693fd0deb6d7d4b9 WatchSource:0}: Error finding container 0027700afb2e05343e311fc5255dd90df7846aca0b146351693fd0deb6d7d4b9: Status 404 returned error can't find the container with id 0027700afb2e05343e311fc5255dd90df7846aca0b146351693fd0deb6d7d4b9
Jul 09 16:51:17.810194 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.810156    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:17.810381 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:17.810215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:17.810381 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.810314    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:17.810381 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.810373    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:18.810358356 +0000 UTC m=+38.143819448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:17.810555 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.810318    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:17.810555 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.810411    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:17.810555 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:17.810445    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:18.810433674 +0000 UTC m=+38.143894781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:18.453246 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:18.453202    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znlmc" event={"ID":"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d","Type":"ContainerStarted","Data":"0027700afb2e05343e311fc5255dd90df7846aca0b146351693fd0deb6d7d4b9"}
Jul 09 16:51:18.817378 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:18.817297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:18.817378 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:18.817370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:18.817896 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:18.817465    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:18.817896 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:18.817493    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:18.817896 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:18.817471    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:18.817896 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:18.817556    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:20.81753626 +0000 UTC m=+40.150997360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:18.817896 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:18.817574    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:20.817564519 +0000 UTC m=+40.151025615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:20.832974 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:20.832736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:20.832913    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:20.833081    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:20.833118    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:20.833047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:20.833159    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.833136232 +0000 UTC m=+44.166597327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:20.833378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:20.833193    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.833186852 +0000 UTC m=+44.166647944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:22.464933 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:22.464892    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znlmc" event={"ID":"7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d","Type":"ContainerStarted","Data":"927810f44a30598452b483338fc2ddf17f5abdc067e8f50bc8c75707706dd399"}
Jul 09 16:51:22.467563 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:22.467537    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="644985ac1531418a0f6ad73c3dfc0b480a4da577b2a5903c4c084f61ac8cf464" exitCode=0
Jul 09 16:51:22.467699 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:22.467583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"644985ac1531418a0f6ad73c3dfc0b480a4da577b2a5903c4c084f61ac8cf464"}
Jul 09 16:51:22.479926 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:22.479885    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-znlmc" podStartSLOduration=0.957613038 podStartE2EDuration="5.479871038s" totalImagesPullingTime="4.522258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:22.479121215 +0000 UTC m=+41.812582348" watchObservedRunningTime="2026-07-09 16:51:22.479871038 +0000 UTC m=+41.813332151"
Jul 09 16:51:23.349704 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.349673    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"]
Jul 09 16:51:23.370105 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.370078    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"]
Jul 09 16:51:23.370320 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.370192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.373139 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.372817    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 16:51:23.373139 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.373006    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-874w7\""
Jul 09 16:51:23.373338 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.373315    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.373544 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.373521    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 16:51:23.373634 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.373533    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.398116 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.398096    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-mrvdr"]
Jul 09 16:51:23.398232 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.398214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"
Jul 09 16:51:23.401014 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.400995    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.401119 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.401016    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.401119 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.401016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qk7h7\""
Jul 09 16:51:23.418978 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.418961    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nr7t8"]
Jul 09 16:51:23.419088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.419073    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.421503 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.421481    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 16:51:23.421600 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.421485    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 16:51:23.421600 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.421529    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sk5j2\""
Jul 09 16:51:23.421763 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.421749    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.421806 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.421797    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.430509 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.430491    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 16:51:23.433669 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.433653    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-656b79498-fhh6t"]
Jul 09 16:51:23.433787 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.433773    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.436269 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.436252    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 16:51:23.436415 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.436393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.436480 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.436433    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-thqpm\""
Jul 09 16:51:23.436726 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.436713    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.436862 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.436849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 16:51:23.441608 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.441588    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 16:51:23.455629 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.455606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.455737 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.455641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-config\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.455737 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.455685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2zp4\" (UniqueName: \"kubernetes.io/projected/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-kube-api-access-l2zp4\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.459199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459120    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"]
Jul 09 16:51:23.459199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459157    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"]
Jul 09 16:51:23.459199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459177    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mrvdr"]
Jul 09 16:51:23.459199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459198    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-656b79498-fhh6t"]
Jul 09 16:51:23.459445 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459211    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nr7t8"]
Jul 09 16:51:23.459445 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459236    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"]
Jul 09 16:51:23.459445 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.459333    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.461878 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.461861    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.461976 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.461917    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 16:51:23.462031 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.462001    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 16:51:23.462514 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.462500    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 16:51:23.462624 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.462588    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.462624 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.462602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jl8qg\""
Jul 09 16:51:23.462624 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.462607    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 16:51:23.472631 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.472611    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee496b5-ee2d-4b49-8395-063901851612" containerID="5bc6a6644dbe2b4bfe43f8653fc22524890e29067b474e6ec5d0eb8e445422d2" exitCode=0
Jul 09 16:51:23.480860 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.480820    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerDied","Data":"5bc6a6644dbe2b4bfe43f8653fc22524890e29067b474e6ec5d0eb8e445422d2"}
Jul 09 16:51:23.480937 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.480874    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"]
Jul 09 16:51:23.480937 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.480894    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"]
Jul 09 16:51:23.480937 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.480900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"
Jul 09 16:51:23.487928 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.487909    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4kphq\""
Jul 09 16:51:23.509797 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.509771    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"]
Jul 09 16:51:23.509998 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.509967    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.512892 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.512870    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 16:51:23.513011 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.512995    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.513163 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.513142    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.514253 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.514235    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 16:51:23.514377 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.514243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lqv4\""
Jul 09 16:51:23.532095 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.532058    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"]
Jul 09 16:51:23.532234 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.532195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.534446 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.534422    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 16:51:23.534768 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.534751    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kl2rq\""
Jul 09 16:51:23.534897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.534757    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.534897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.534843    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.554164 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.554112    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"]
Jul 09 16:51:23.554314 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.554224    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"]
Jul 09 16:51:23.554314 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.554248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"]
Jul 09 16:51:23.554427 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.554346    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.556826 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.556805    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 16:51:23.556967 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.556852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.556967 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.556937    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5vlb4\""
Jul 09 16:51:23.556967 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.556954    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5147479c-6df1-4a9f-83c2-563a015f1670-serving-cert\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.557148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c063fa-cfe0-4db5-b346-95fa68c4f678-serving-cert\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.557148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k895w\" (UniqueName: \"kubernetes.io/projected/d23d8333-5014-4699-806d-2807fec43376-kube-api-access-k895w\") pod \"volume-data-source-validator-78495597f6-qk8bw\" (UID: \"d23d8333-5014-4699-806d-2807fec43376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"
Jul 09 16:51:23.557148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557110    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2zp4\" (UniqueName: \"kubernetes.io/projected/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-kube-api-access-l2zp4\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.557299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.557299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.557299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-trusted-ca\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.557299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-config\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.557493 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557319    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpjxz\" (UniqueName: \"kubernetes.io/projected/b0c063fa-cfe0-4db5-b346-95fa68c4f678-kube-api-access-gpjxz\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.557493 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgj4c\" (UniqueName: \"kubernetes.io/projected/4c35b51d-1e89-414c-aabb-e207e27e4af6-kube-api-access-fgj4c\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.557493 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.557493 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557408    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 16:51:23.557717 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557686    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-config\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.557872 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.557851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwcch\" (UniqueName: \"kubernetes.io/projected/5147479c-6df1-4a9f-83c2-563a015f1670-kube-api-access-jwcch\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-stats-auth\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-tmp\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558174    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"]
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-default-certificate\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558275    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-config\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-snapshots\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.558399 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.558360    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.561139 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.561117    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.576699 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.576671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2zp4\" (UniqueName: \"kubernetes.io/projected/233cc2e5-3a05-4b06-9fff-5ef1aa10362f-kube-api-access-l2zp4\") pod \"service-ca-operator-7695fc6c8c-ffq9p\" (UID: \"233cc2e5-3a05-4b06-9fff-5ef1aa10362f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.596198 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.596176    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"]
Jul 09 16:51:23.596327 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.596304    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.598942 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.598912    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 16:51:23.598942 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.598912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 16:51:23.599099 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.598998    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 16:51:23.599195 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.599181    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:51:23.599433 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.599416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6c8hp\""
Jul 09 16:51:23.659114 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c063fa-cfe0-4db5-b346-95fa68c4f678-serving-cert\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.659226 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k895w\" (UniqueName: \"kubernetes.io/projected/d23d8333-5014-4699-806d-2807fec43376-kube-api-access-k895w\") pod \"volume-data-source-validator-78495597f6-qk8bw\" (UID: \"d23d8333-5014-4699-806d-2807fec43376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"
Jul 09 16:51:23.659226 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659152    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtrs\" (UniqueName: \"kubernetes.io/projected/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-kube-api-access-8jtrs\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.659304 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.659338 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.659374 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5gh\" (UniqueName: \"kubernetes.io/projected/9580010c-ee18-489f-b1d7-c0753b9d822c-kube-api-access-7l5gh\") pod \"network-check-source-869dcfcdcd-6vjr9\" (UID: \"9580010c-ee18-489f-b1d7-c0753b9d822c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"
Jul 09 16:51:23.659406 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-trusted-ca\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.659451 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpjxz\" (UniqueName: \"kubernetes.io/projected/b0c063fa-cfe0-4db5-b346-95fa68c4f678-kube-api-access-gpjxz\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.659498 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.659449    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.159430515 +0000 UTC m=+43.492891628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:23.659498 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.659591 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgj4c\" (UniqueName: \"kubernetes.io/projected/4c35b51d-1e89-414c-aabb-e207e27e4af6-kube-api-access-fgj4c\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.659591 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659534    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.659591 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.659728 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.659772 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659731    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnq5m\" (UniqueName: \"kubernetes.io/projected/e763fcec-bad5-4349-b5a0-e52721a9a423-kube-api-access-wnq5m\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.659810 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-config\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.659891 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwcch\" (UniqueName: \"kubernetes.io/projected/5147479c-6df1-4a9f-83c2-563a015f1670-kube-api-access-jwcch\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.659891 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-stats-auth\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.659891 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.660034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659904    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-tmp\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.660034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-default-certificate\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.660034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.659957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-snapshots\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.660239 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.660298 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.660298 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5147479c-6df1-4a9f-83c2-563a015f1670-serving-cert\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.660396 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-trusted-ca\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.660396 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660322    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.660501 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.660419    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:23.660501 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.660478    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.160462059 +0000 UTC m=+43.493923168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:23.660501 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5147479c-6df1-4a9f-83c2-563a015f1670-config\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.660611 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-tmp\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.660893 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.660868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0c063fa-cfe0-4db5-b346-95fa68c4f678-snapshots\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.661097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c063fa-cfe0-4db5-b346-95fa68c4f678-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.661665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c063fa-cfe0-4db5-b346-95fa68c4f678-serving-cert\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.662194    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-stats-auth\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.662577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-default-certificate\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.662694    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5147479c-6df1-4a9f-83c2-563a015f1670-serving-cert\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.670125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgj4c\" (UniqueName: \"kubernetes.io/projected/4c35b51d-1e89-414c-aabb-e207e27e4af6-kube-api-access-fgj4c\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:23.670598 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.670343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwcch\" (UniqueName: \"kubernetes.io/projected/5147479c-6df1-4a9f-83c2-563a015f1670-kube-api-access-jwcch\") pod \"console-operator-7866497494-mrvdr\" (UID: \"5147479c-6df1-4a9f-83c2-563a015f1670\") " pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.670994 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.670714    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k895w\" (UniqueName: \"kubernetes.io/projected/d23d8333-5014-4699-806d-2807fec43376-kube-api-access-k895w\") pod \"volume-data-source-validator-78495597f6-qk8bw\" (UID: \"d23d8333-5014-4699-806d-2807fec43376\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"
Jul 09 16:51:23.671090 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.671071    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpjxz\" (UniqueName: \"kubernetes.io/projected/b0c063fa-cfe0-4db5-b346-95fa68c4f678-kube-api-access-gpjxz\") pod \"insights-operator-68d9dd94cf-nr7t8\" (UID: \"b0c063fa-cfe0-4db5-b346-95fa68c4f678\") " pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.680905 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.680890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"
Jul 09 16:51:23.705815 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.705792    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"
Jul 09 16:51:23.730413 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.730377    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:23.742545 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.742515    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8"
Jul 09 16:51:23.761629 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.761759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.761759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.761759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnq5m\" (UniqueName: \"kubernetes.io/projected/e763fcec-bad5-4349-b5a0-e52721a9a423-kube-api-access-wnq5m\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.761759 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvvwh\" (UniqueName: \"kubernetes.io/projected/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-kube-api-access-lvvwh\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.761992 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.761992 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.761810    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:23.761992 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.761916    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.261894773 +0000 UTC m=+43.595355888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:23.761992 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.761987    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:23.762191 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.762037    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.262022359 +0000 UTC m=+43.595483468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:23.762191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.761984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtrs\" (UniqueName: \"kubernetes.io/projected/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-kube-api-access-8jtrs\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.762191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.762070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.762191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.762099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.762191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.762176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5gh\" (UniqueName: \"kubernetes.io/projected/9580010c-ee18-489f-b1d7-c0753b9d822c-kube-api-access-7l5gh\") pod \"network-check-source-869dcfcdcd-6vjr9\" (UID: \"9580010c-ee18-489f-b1d7-c0753b9d822c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"
Jul 09 16:51:23.762922 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.762205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.762922 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.762332    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:23.762922 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:23.762370    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:24.262357896 +0000 UTC m=+43.595818993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:23.762922 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.762418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.763164 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.763056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:23.772153 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.772093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnq5m\" (UniqueName: \"kubernetes.io/projected/e763fcec-bad5-4349-b5a0-e52721a9a423-kube-api-access-wnq5m\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:23.776885 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.776214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5gh\" (UniqueName: \"kubernetes.io/projected/9580010c-ee18-489f-b1d7-c0753b9d822c-kube-api-access-7l5gh\") pod \"network-check-source-869dcfcdcd-6vjr9\" (UID: \"9580010c-ee18-489f-b1d7-c0753b9d822c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"
Jul 09 16:51:23.776885 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.776491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtrs\" (UniqueName: \"kubernetes.io/projected/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-kube-api-access-8jtrs\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:23.789085 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.788886    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"
Jul 09 16:51:23.855495 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.854241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p"]
Jul 09 16:51:23.863636 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.863612    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.863726 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.863683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.863868 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.863768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvvwh\" (UniqueName: \"kubernetes.io/projected/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-kube-api-access-lvvwh\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.865158 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.865082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.868580 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.868544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.874322 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.874301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvvwh\" (UniqueName: \"kubernetes.io/projected/52a1fd8c-77d3-4436-a1d6-e24b1bf057e7-kube-api-access-lvvwh\") pod \"kube-storage-version-migrator-operator-799cb7f958-46p8l\" (UID: \"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.883243 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.883034    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw"]
Jul 09 16:51:23.885755 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:23.885720    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23d8333_5014_4699_806d_2807fec43376.slice/crio-a3c285636b8badf380e9af15d7378ae8b5c5da0f3f3d72efa6707375b0640842 WatchSource:0}: Error finding container a3c285636b8badf380e9af15d7378ae8b5c5da0f3f3d72efa6707375b0640842: Status 404 returned error can't find the container with id a3c285636b8badf380e9af15d7378ae8b5c5da0f3f3d72efa6707375b0640842
Jul 09 16:51:23.907190 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.906995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"
Jul 09 16:51:23.917229 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.917202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mrvdr"]
Jul 09 16:51:23.920627 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:23.920596    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5147479c_6df1_4a9f_83c2_563a015f1670.slice/crio-982d927245045abf2535a2482b78b731b0632ac4273bf886d65bcd160b7a786e WatchSource:0}: Error finding container 982d927245045abf2535a2482b78b731b0632ac4273bf886d65bcd160b7a786e: Status 404 returned error can't find the container with id 982d927245045abf2535a2482b78b731b0632ac4273bf886d65bcd160b7a786e
Jul 09 16:51:23.940099 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.940007    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nr7t8"]
Jul 09 16:51:23.943012 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:23.942978    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c063fa_cfe0_4db5_b346_95fa68c4f678.slice/crio-8929fcb2a6fc52aecd6c8e9a11b166986213a81839b97e1227825e8a4d233b6b WatchSource:0}: Error finding container 8929fcb2a6fc52aecd6c8e9a11b166986213a81839b97e1227825e8a4d233b6b: Status 404 returned error can't find the container with id 8929fcb2a6fc52aecd6c8e9a11b166986213a81839b97e1227825e8a4d233b6b
Jul 09 16:51:23.959520 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:23.959422    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9"]
Jul 09 16:51:23.962962 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:23.962936    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9580010c_ee18_489f_b1d7_c0753b9d822c.slice/crio-99aba6d165c21f4a995b2f2e5dc4acd6217fb89850f51065289ac8d1008eda4f WatchSource:0}: Error finding container 99aba6d165c21f4a995b2f2e5dc4acd6217fb89850f51065289ac8d1008eda4f: Status 404 returned error can't find the container with id 99aba6d165c21f4a995b2f2e5dc4acd6217fb89850f51065289ac8d1008eda4f
Jul 09 16:51:24.043016 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.042990    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l"]
Jul 09 16:51:24.046057 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:24.046029    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a1fd8c_77d3_4436_a1d6_e24b1bf057e7.slice/crio-b8a416cfa6c919a978764ab0f4f3ec2644baf83e207af7f75d554bb9b274e75e WatchSource:0}: Error finding container b8a416cfa6c919a978764ab0f4f3ec2644baf83e207af7f75d554bb9b274e75e: Status 404 returned error can't find the container with id b8a416cfa6c919a978764ab0f4f3ec2644baf83e207af7f75d554bb9b274e75e
Jul 09 16:51:24.166037 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.166006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:24.166201 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.166083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:24.166201 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.166171    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:24.166288 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.166206    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.166183785 +0000 UTC m=+44.499644886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:24.166288 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.166228    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.166220584 +0000 UTC m=+44.499681676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:24.267314 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.267271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:24.267504 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.267386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:24.267504 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.267405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:24.267504 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267442    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:24.267504 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267493    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:24.267678 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267514    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:24.267678 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267526    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.26750475 +0000 UTC m=+44.600965841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:24.267678 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267548    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.267537361 +0000 UTC m=+44.600998454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:24.267678 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.267564    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:25.267554784 +0000 UTC m=+44.601015884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:24.480487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.480406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fplk" event={"ID":"eee496b5-ee2d-4b49-8395-063901851612","Type":"ContainerStarted","Data":"0347406406be8a8dc8699c40211614facb17c1e50aa57fe32114acdeebdaa32f"}
Jul 09 16:51:24.481798 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.481740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p" event={"ID":"233cc2e5-3a05-4b06-9fff-5ef1aa10362f","Type":"ContainerStarted","Data":"940ab5dbb55b5a141db598d88e07c16749823109954e87b7ec0291e6d978e178"}
Jul 09 16:51:24.483131 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.483080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9" event={"ID":"9580010c-ee18-489f-b1d7-c0753b9d822c","Type":"ContainerStarted","Data":"99aba6d165c21f4a995b2f2e5dc4acd6217fb89850f51065289ac8d1008eda4f"}
Jul 09 16:51:24.484419 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.484384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mrvdr" event={"ID":"5147479c-6df1-4a9f-83c2-563a015f1670","Type":"ContainerStarted","Data":"982d927245045abf2535a2482b78b731b0632ac4273bf886d65bcd160b7a786e"}
Jul 09 16:51:24.486159 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.486130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw" event={"ID":"d23d8333-5014-4699-806d-2807fec43376","Type":"ContainerStarted","Data":"a3c285636b8badf380e9af15d7378ae8b5c5da0f3f3d72efa6707375b0640842"}
Jul 09 16:51:24.487510 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.487487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l" event={"ID":"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7","Type":"ContainerStarted","Data":"b8a416cfa6c919a978764ab0f4f3ec2644baf83e207af7f75d554bb9b274e75e"}
Jul 09 16:51:24.488873 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.488849    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8" event={"ID":"b0c063fa-cfe0-4db5-b346-95fa68c4f678","Type":"ContainerStarted","Data":"8929fcb2a6fc52aecd6c8e9a11b166986213a81839b97e1227825e8a4d233b6b"}
Jul 09 16:51:24.504763 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.503347    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8fplk" podStartSLOduration=8.875204694 podStartE2EDuration="43.503328342s" totalImagesPullingTime="34.628123648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.501797365 +0000 UTC m=+43.835258515" watchObservedRunningTime="2026-07-09 16:51:24.503328342 +0000 UTC m=+43.836789450"
Jul 09 16:51:24.874211 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.874173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:24.874400 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:24.874321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:24.874400 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.874339    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:24.874526 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.874456    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:32.874412334 +0000 UTC m=+52.207873449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:24.874590 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.874525    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:24.874590 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.874556    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:24.874686 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:24.874608    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:32.874591366 +0000 UTC m=+52.208052467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:25.178462 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:25.177536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:25.178462 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:25.177659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:25.178462 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.177881    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.177861277 +0000 UTC m=+46.511322375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:25.178462 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.178322    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:25.178462 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.178372    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.178357341 +0000 UTC m=+46.511818437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:25.279007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:25.279060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:25.279115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279265    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279327    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.279308549 +0000 UTC m=+46.612769654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279713    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279764    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.279748984 +0000 UTC m=+46.613210090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279815    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:25.279917 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:25.279864    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:27.279851765 +0000 UTC m=+46.613312858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:27.197498 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:27.197467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:27.197859 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:27.197536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:27.197859 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.197618    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:27.197859 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.197647    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:31.197629208 +0000 UTC m=+50.531090299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:27.197859 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.197675    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:31.197663315 +0000 UTC m=+50.531124411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:27.298628 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:27.298590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:27.298778 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:27.298724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:27.298778 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298741    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:27.298875 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298803    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:31.298786909 +0000 UTC m=+50.632248002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:27.298875 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:27.298749    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:27.298875 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298827    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:27.298875 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298864    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:27.299030 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298916    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:31.298894706 +0000 UTC m=+50.632355799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:27.299030 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:27.298934    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:31.298925204 +0000 UTC m=+50.632386297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:30.509594 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.509564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mrvdr" event={"ID":"5147479c-6df1-4a9f-83c2-563a015f1670","Type":"ContainerStarted","Data":"822e69ec841838d72e8751149e8f782d9c5c1c8d01d1b0bf3b8404f2b1963444"}
Jul 09 16:51:30.509962 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.509892    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:30.511945 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.511820    2570 patch_prober.go:28] interesting pod/console-operator-7866497494-mrvdr container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body=
Jul 09 16:51:30.511945 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.511890    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused"
Jul 09 16:51:30.512819 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.512337    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw" event={"ID":"d23d8333-5014-4699-806d-2807fec43376","Type":"ContainerStarted","Data":"0514186c726f18864110e1d8af14e2791be83cc3fec5d2b588ec3d1ef8f86371"}
Jul 09 16:51:30.516291 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.516266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p" event={"ID":"233cc2e5-3a05-4b06-9fff-5ef1aa10362f","Type":"ContainerStarted","Data":"17d392d40fdcadbd4bb6058c8bfc2a77158b907a8a7813b3bbc8b7a8a046ecbc"}
Jul 09 16:51:30.533029 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.532959    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podStartSLOduration=1.122877025 podStartE2EDuration="7.532935947s" totalImagesPullingTime="6.410058922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:30.532906071 +0000 UTC m=+49.866367202" watchObservedRunningTime="2026-07-09 16:51:30.532935947 +0000 UTC m=+49.866397063"
Jul 09 16:51:30.551223 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:30.551091    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qk8bw" podStartSLOduration=1.186751447 podStartE2EDuration="7.551071286s" totalImagesPullingTime="6.364319839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:30.550869072 +0000 UTC m=+49.884330186" watchObservedRunningTime="2026-07-09 16:51:30.551071286 +0000 UTC m=+49.884532401"
Jul 09 16:51:31.234856 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.234804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:31.235281 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.235166    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:31.235403 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.235348    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.235322883 +0000 UTC m=+58.568783977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:31.235533 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.235504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:31.235740 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.235722    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.235703272 +0000 UTC m=+58.569164390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:31.252214 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.252182    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h48lk"]
Jul 09 16:51:31.274909 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.274879    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h48lk"]
Jul 09 16:51:31.275046 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.274933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.277534 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.277461    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 16:51:31.277534 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.277490    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 16:51:31.277767 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.277753    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jjsxm\""
Jul 09 16:51:31.336722 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.336684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:31.336918 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.336729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:31.336918 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.336781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:31.336918 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.336843    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:31.336918 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.336914    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:31.337147 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.336993    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:31.337147 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.336919    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.336898066 +0000 UTC m=+58.670359161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:31.337147 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.337027    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.337014979 +0000 UTC m=+58.670476071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:31.337147 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.337044    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.337035297 +0000 UTC m=+58.670496391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:31.437736 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.437695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.437950 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.437821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-data-volume\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.437950 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.437912    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.438054 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.437974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-crio-socket\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.438054 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.438044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dl9\" (UniqueName: \"kubernetes.io/projected/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-api-access-f7dl9\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.522132 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.522013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9" event={"ID":"9580010c-ee18-489f-b1d7-c0753b9d822c","Type":"ContainerStarted","Data":"0c79af8a2ede164ccb7d5be641a01158d92e938d95e17cc50e580e2ae64ec3be"}
Jul 09 16:51:31.523703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.523683    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/0.log"
Jul 09 16:51:31.523858 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.523723    2570 generic.go:356] "Generic (PLEG): container finished" podID="5147479c-6df1-4a9f-83c2-563a015f1670" containerID="822e69ec841838d72e8751149e8f782d9c5c1c8d01d1b0bf3b8404f2b1963444" exitCode=255
Jul 09 16:51:31.523858 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.523807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mrvdr" event={"ID":"5147479c-6df1-4a9f-83c2-563a015f1670","Type":"ContainerDied","Data":"822e69ec841838d72e8751149e8f782d9c5c1c8d01d1b0bf3b8404f2b1963444"}
Jul 09 16:51:31.524029 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.524011    2570 scope.go:117] "RemoveContainer" containerID="822e69ec841838d72e8751149e8f782d9c5c1c8d01d1b0bf3b8404f2b1963444"
Jul 09 16:51:31.525622 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.525598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l" event={"ID":"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7","Type":"ContainerStarted","Data":"7dbc39fa0afcabcd3f3b68616dea2408f8bda47e464c540ae74971ca796af0f1"}
Jul 09 16:51:31.527280 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.527255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8" event={"ID":"b0c063fa-cfe0-4db5-b346-95fa68c4f678","Type":"ContainerStarted","Data":"06056641e1c2af546a4ce86aaf67fece1b9c6f022bdd95e7a84852761aec0ab0"}
Jul 09 16:51:31.536439 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.536389    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6vjr9" podStartSLOduration=2.157768615 podStartE2EDuration="8.536373125s" totalImagesPullingTime="6.37860451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:31.536015512 +0000 UTC m=+50.869476627" watchObservedRunningTime="2026-07-09 16:51:31.536373125 +0000 UTC m=+50.869834241"
Jul 09 16:51:31.538564 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.538541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.538682 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.538664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-data-volume\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.538735 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.538707    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:31.538783 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.538758    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 16:51:31.538783 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.538771    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:32.038753117 +0000 UTC m=+51.372214215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:31.538913 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:31.538819    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:32.038803849 +0000 UTC m=+51.372264944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : configmap "kube-rbac-proxy" not found
Jul 09 16:51:31.538913 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.538707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.538913 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.538881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-crio-socket\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.539067 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.538990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dl9\" (UniqueName: \"kubernetes.io/projected/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-api-access-f7dl9\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.539124 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.539105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-data-volume\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.539200 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.539182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-crio-socket\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.552495 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.552472    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dl9\" (UniqueName: \"kubernetes.io/projected/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-api-access-f7dl9\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:31.556058 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.556020    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l" podStartSLOduration=2.270755055 podStartE2EDuration="8.556007038s" totalImagesPullingTime="6.285251983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:31.55487809 +0000 UTC m=+50.888339230" watchObservedRunningTime="2026-07-09 16:51:31.556007038 +0000 UTC m=+50.889468152"
Jul 09 16:51:31.570731 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.570638    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p" podStartSLOduration=2.100784955 podStartE2EDuration="8.570618943s" totalImagesPullingTime="6.469833988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:31.568877176 +0000 UTC m=+50.902338316" watchObservedRunningTime="2026-07-09 16:51:31.570618943 +0000 UTC m=+50.904080061"
Jul 09 16:51:31.606321 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:31.606270    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8" podStartSLOduration=2.219126012 podStartE2EDuration="8.606249042s" totalImagesPullingTime="6.38712303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:31.605132926 +0000 UTC m=+50.938594070" watchObservedRunningTime="2026-07-09 16:51:31.606249042 +0000 UTC m=+50.939710156"
Jul 09 16:51:32.044023 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.043987    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:32.044191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.044110    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:32.044191 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.044146    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:32.044289 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.044213    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:33.04419354 +0000 UTC m=+52.377654633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:32.044289 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.044251    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 16:51:32.044378 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.044325    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:33.044304874 +0000 UTC m=+52.377765983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : configmap "kube-rbac-proxy" not found
Jul 09 16:51:32.531795 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.531766    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 16:51:32.532238 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.532222    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/0.log"
Jul 09 16:51:32.532282 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.532257    2570 generic.go:356] "Generic (PLEG): container finished" podID="5147479c-6df1-4a9f-83c2-563a015f1670" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6" exitCode=255
Jul 09 16:51:32.532387 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.532359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mrvdr" event={"ID":"5147479c-6df1-4a9f-83c2-563a015f1670","Type":"ContainerDied","Data":"abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"}
Jul 09 16:51:32.532516 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.532437    2570 scope.go:117] "RemoveContainer" containerID="822e69ec841838d72e8751149e8f782d9c5c1c8d01d1b0bf3b8404f2b1963444"
Jul 09 16:51:32.532590 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.532531    2570 scope.go:117] "RemoveContainer" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"
Jul 09 16:51:32.532729 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.532706    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mrvdr_openshift-console-operator(5147479c-6df1-4a9f-83c2-563a015f1670)\"" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670"
Jul 09 16:51:32.656109 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.656080    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vll5_465f24b0-84be-4cc7-822b-313c33b37a3f/dns-node-resolver/0.log"
Jul 09 16:51:32.951930 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.951896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:32.952112 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:32.951968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:32.952112 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.952035    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 16:51:32.952112 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.952102    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 16:51:32.952227 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.952121    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bc5cf7f9-72thh: secret "image-registry-tls" not found
Jul 09 16:51:32.952227 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.952107    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls podName:f1403ef1-99fe-4e7f-8193-45884c314367 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:48.952092184 +0000 UTC m=+68.285553278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls") pod "dns-default-5nlhj" (UID: "f1403ef1-99fe-4e7f-8193-45884c314367") : secret "dns-default-metrics-tls" not found
Jul 09 16:51:32.952227 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:32.952191    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls podName:b6f28040-5046-4c61-94d7-96ca0422fad7 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:48.952170541 +0000 UTC m=+68.285631636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls") pod "image-registry-56bc5cf7f9-72thh" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7") : secret "image-registry-tls" not found
Jul 09 16:51:33.052794 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.052763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:33.052970 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.052879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:33.052970 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:33.052930    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:33.053071 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:33.052990    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:35.052975362 +0000 UTC m=+54.386436456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:33.053432 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.053410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:33.536559 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.536529    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 16:51:33.537027 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.536867    2570 scope.go:117] "RemoveContainer" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"
Jul 09 16:51:33.537027 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:33.537010    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mrvdr_openshift-console-operator(5147479c-6df1-4a9f-83c2-563a015f1670)\"" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670"
Jul 09 16:51:33.730842 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.730793    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:33.857118 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:33.857048    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-td7lj_a6998544-d4eb-4286-9185-92be919467de/node-ca/0.log"
Jul 09 16:51:34.541147 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:34.541125    2570 scope.go:117] "RemoveContainer" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"
Jul 09 16:51:34.541513 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:34.541286    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mrvdr_openshift-console-operator(5147479c-6df1-4a9f-83c2-563a015f1670)\"" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670"
Jul 09 16:51:34.657073 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:34.657035    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znlmc_7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d/serve-healthcheck-canary/0.log"
Jul 09 16:51:35.073008 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:35.072972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:35.073253 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:35.073124    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:35.073253 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:35.073200    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:39.073185168 +0000 UTC m=+58.406646260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:39.106219 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.106179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:39.106602 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.106342    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:39.106602 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.106416    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls podName:e24b974f-d9f5-4ab9-8d54-0ec6a41590ae nodeName:}" failed. No retries permitted until 2026-07-09 16:51:47.106396843 +0000 UTC m=+66.439857958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h48lk" (UID: "e24b974f-d9f5-4ab9-8d54-0ec6a41590ae") : secret "insights-runtime-extractor-tls" not found
Jul 09 16:51:39.307996 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.307959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:39.308164 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.308039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:39.308164 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.308113    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 16:51:39.308246 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.308193    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:55.30817342 +0000 UTC m=+74.641634513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : secret "router-metrics-certs-default" not found
Jul 09 16:51:39.308246 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.308213    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle podName:4c35b51d-1e89-414c-aabb-e207e27e4af6 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:55.308206576 +0000 UTC m=+74.641667667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle") pod "router-default-656b79498-fhh6t" (UID: "4c35b51d-1e89-414c-aabb-e207e27e4af6") : configmap references non-existent config key: service-ca.crt
Jul 09 16:51:39.409211 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.409180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:39.409346 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.409216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:39.409346 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:39.409264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:39.409346 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409332    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 16:51:39.409450 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409346    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 16:51:39.409450 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409333    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:39.409450 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409390    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls podName:e763fcec-bad5-4349-b5a0-e52721a9a423 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:55.40937604 +0000 UTC m=+74.742837132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls") pod "cluster-samples-operator-65db858894-zvtvw" (UID: "e763fcec-bad5-4349-b5a0-e52721a9a423") : secret "samples-operator-tls" not found
Jul 09 16:51:39.409450 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409407    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls podName:eb3fc3ea-0f26-42b2-8e85-30666d3ab281 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:55.409395711 +0000 UTC m=+74.742856804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wd84b" (UID: "eb3fc3ea-0f26-42b2-8e85-30666d3ab281") : secret "cluster-monitoring-operator-tls" not found
Jul 09 16:51:39.409450 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:39.409426    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert podName:72e7e3d9-e930-4b7a-8ab0-3213a2179bbc nodeName:}" failed. No retries permitted until 2026-07-09 16:51:55.409416918 +0000 UTC m=+74.742878017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xmtd" (UID: "72e7e3d9-e930-4b7a-8ab0-3213a2179bbc") : secret "networking-console-plugin-cert" not found
Jul 09 16:51:40.510210 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:40.510181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:40.510686 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:40.510669    2570 scope.go:117] "RemoveContainer" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"
Jul 09 16:51:40.510955 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:40.510933    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mrvdr_openshift-console-operator(5147479c-6df1-4a9f-83c2-563a015f1670)\"" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670"
Jul 09 16:51:42.445234 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:42.445208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxvbt"
Jul 09 16:51:46.868315 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.868270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:46.868710 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.868370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:51:46.871108 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.871085    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 16:51:46.871223 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.871086    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 16:51:46.879298 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:46.879277    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 16:51:46.879355 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:51:46.879341    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs podName:3b703ef6-819e-4f10-8e6e-bcbd45aea824 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:50.879322799 +0000 UTC m=+130.212783896 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs") pod "network-metrics-daemon-82qqg" (UID: "3b703ef6-819e-4f10-8e6e-bcbd45aea824") : secret "metrics-daemon-secret" not found
Jul 09 16:51:46.881557 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.881540    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/205d0beb-7cf0-4dc6-b0a3-854be0c73afa-original-pull-secret\") pod \"global-pull-secret-syncer-tn6kw\" (UID: \"205d0beb-7cf0-4dc6-b0a3-854be0c73afa\") " pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:46.905071 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.905043    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tn6kw"
Jul 09 16:51:46.969672 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.969641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:46.972285 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:46.972258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l92m\" (UniqueName: \"kubernetes.io/projected/9fd1f3fe-a441-4e54-a541-c5e7146ec0fe-kube-api-access-2l92m\") pod \"network-check-target-fgfm2\" (UID: \"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe\") " pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:47.028488 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.028452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tn6kw"]
Jul 09 16:51:47.031348 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:47.031317    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205d0beb_7cf0_4dc6_b0a3_854be0c73afa.slice/crio-08ced313b2d585dcbfcee8c7e958d5197fd7873622f5e8c6a4a1b88d580acf39 WatchSource:0}: Error finding container 08ced313b2d585dcbfcee8c7e958d5197fd7873622f5e8c6a4a1b88d580acf39: Status 404 returned error can't find the container with id 08ced313b2d585dcbfcee8c7e958d5197fd7873622f5e8c6a4a1b88d580acf39
Jul 09 16:51:47.171255 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.171215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:47.173521 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.173497    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24b974f-d9f5-4ab9-8d54-0ec6a41590ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h48lk\" (UID: \"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae\") " pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:47.187958 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.187939    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jjsxm\""
Jul 09 16:51:47.196241 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.196226    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h48lk"
Jul 09 16:51:47.203243 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.203193    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2fgzg\""
Jul 09 16:51:47.210917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.210893    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:47.332462 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.332435    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h48lk"]
Jul 09 16:51:47.334839 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:47.334800    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24b974f_d9f5_4ab9_8d54_0ec6a41590ae.slice/crio-3f0d430802da75eb41fcd5fe80fae9626b30a8bb65c6ea007ee78d967087e685 WatchSource:0}: Error finding container 3f0d430802da75eb41fcd5fe80fae9626b30a8bb65c6ea007ee78d967087e685: Status 404 returned error can't find the container with id 3f0d430802da75eb41fcd5fe80fae9626b30a8bb65c6ea007ee78d967087e685
Jul 09 16:51:47.344947 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.344912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgfm2"]
Jul 09 16:51:47.350234 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:47.350194    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd1f3fe_a441_4e54_a541_c5e7146ec0fe.slice/crio-eea1f43e97dac629315d6437f1a732ee53818a6d14045d5bfb1ea41c168cea5b WatchSource:0}: Error finding container eea1f43e97dac629315d6437f1a732ee53818a6d14045d5bfb1ea41c168cea5b: Status 404 returned error can't find the container with id eea1f43e97dac629315d6437f1a732ee53818a6d14045d5bfb1ea41c168cea5b
Jul 09 16:51:47.585021 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.584930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgfm2" event={"ID":"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe","Type":"ContainerStarted","Data":"23687b45b8ac9cb4c788d884cd0a53e2fd80b32685057e5a14ba261aee39001b"}
Jul 09 16:51:47.585021 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.584999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgfm2" event={"ID":"9fd1f3fe-a441-4e54-a541-c5e7146ec0fe","Type":"ContainerStarted","Data":"eea1f43e97dac629315d6437f1a732ee53818a6d14045d5bfb1ea41c168cea5b"}
Jul 09 16:51:47.585245 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.585078    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:51:47.586361 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.586336    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tn6kw" event={"ID":"205d0beb-7cf0-4dc6-b0a3-854be0c73afa","Type":"ContainerStarted","Data":"08ced313b2d585dcbfcee8c7e958d5197fd7873622f5e8c6a4a1b88d580acf39"}
Jul 09 16:51:47.587608 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.587578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h48lk" event={"ID":"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae","Type":"ContainerStarted","Data":"3f0d430802da75eb41fcd5fe80fae9626b30a8bb65c6ea007ee78d967087e685"}
Jul 09 16:51:47.601258 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:47.601197    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fgfm2" podStartSLOduration=66.601177404 podStartE2EDuration="1m6.601177404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:47.600935783 +0000 UTC m=+66.934396921" watchObservedRunningTime="2026-07-09 16:51:47.601177404 +0000 UTC m=+66.934638519"
Jul 09 16:51:48.990843 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:48.990791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:48.991319 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:48.990865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:48.993690 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:48.993660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1403ef1-99fe-4e7f-8193-45884c314367-metrics-tls\") pod \"dns-default-5nlhj\" (UID: \"f1403ef1-99fe-4e7f-8193-45884c314367\") " pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:48.993875 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:48.993856    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"image-registry-56bc5cf7f9-72thh\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") " pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:49.159217 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:49.159180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2wj2f\""
Jul 09 16:51:49.166917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:49.166891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:49.172788 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:49.172759    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vwg8\""
Jul 09 16:51:49.181217 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:49.181198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:53.383077 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.383034    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:51:53.387341 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:53.387303    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f28040_5046_4c61_94d7_96ca0422fad7.slice/crio-ae40944c76419b6fe0fb8c1ea75ec8c6397882234fd9e81a867169f614c4d376 WatchSource:0}: Error finding container ae40944c76419b6fe0fb8c1ea75ec8c6397882234fd9e81a867169f614c4d376: Status 404 returned error can't find the container with id ae40944c76419b6fe0fb8c1ea75ec8c6397882234fd9e81a867169f614c4d376
Jul 09 16:51:53.409591 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.409568    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nlhj"]
Jul 09 16:51:53.412217 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:53.412189    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1403ef1_99fe_4e7f_8193_45884c314367.slice/crio-b93af5740e616d78ee90884b5e9013a86704b893e39ba5ac210f26b71e0c05ec WatchSource:0}: Error finding container b93af5740e616d78ee90884b5e9013a86704b893e39ba5ac210f26b71e0c05ec: Status 404 returned error can't find the container with id b93af5740e616d78ee90884b5e9013a86704b893e39ba5ac210f26b71e0c05ec
Jul 09 16:51:53.611077 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.611041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h48lk" event={"ID":"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae","Type":"ContainerStarted","Data":"a826c55d044565b473f6aedf8a4a8740f82333ccbda371621c98465957b4b692"}
Jul 09 16:51:53.612518 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.612495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" event={"ID":"b6f28040-5046-4c61-94d7-96ca0422fad7","Type":"ContainerStarted","Data":"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"}
Jul 09 16:51:53.612622 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.612534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" event={"ID":"b6f28040-5046-4c61-94d7-96ca0422fad7","Type":"ContainerStarted","Data":"ae40944c76419b6fe0fb8c1ea75ec8c6397882234fd9e81a867169f614c4d376"}
Jul 09 16:51:53.612622 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.612580    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:51:53.613619 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.613595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nlhj" event={"ID":"f1403ef1-99fe-4e7f-8193-45884c314367","Type":"ContainerStarted","Data":"b93af5740e616d78ee90884b5e9013a86704b893e39ba5ac210f26b71e0c05ec"}
Jul 09 16:51:53.614917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.614898    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tn6kw" event={"ID":"205d0beb-7cf0-4dc6-b0a3-854be0c73afa","Type":"ContainerStarted","Data":"07b417fdb1b9049f2c06279433b5e24e2a4cd7bf7d4458ca1722dee04c35e52b"}
Jul 09 16:51:53.636438 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.636397    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" podStartSLOduration=72.636384016 podStartE2EDuration="1m12.636384016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:53.634626063 +0000 UTC m=+72.968087198" watchObservedRunningTime="2026-07-09 16:51:53.636384016 +0000 UTC m=+72.969845130"
Jul 09 16:51:53.650709 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:53.650672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tn6kw" podStartSLOduration=66.441603331 podStartE2EDuration="1m12.650657887s" totalImagesPullingTime="6.209054556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:53.649877447 +0000 UTC m=+72.983338581" watchObservedRunningTime="2026-07-09 16:51:53.650657887 +0000 UTC m=+72.984119000"
Jul 09 16:51:54.199823 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.199755    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"]
Jul 09 16:51:54.201706 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.201690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.204860 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.204820    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 16:51:54.205034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.205018    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 16:51:54.205115 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.205100    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 16:51:54.205897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.205882    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 16:51:54.216156 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.216127    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"]
Jul 09 16:51:54.341859 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.341811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400acb86-1f18-4b63-8417-87ca003a787e-tmp\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.342030 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.341946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flx8\" (UniqueName: \"kubernetes.io/projected/400acb86-1f18-4b63-8417-87ca003a787e-kube-api-access-7flx8\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.342078 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.342039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/400acb86-1f18-4b63-8417-87ca003a787e-klusterlet-config\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.442636 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.442598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/400acb86-1f18-4b63-8417-87ca003a787e-klusterlet-config\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.443105 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.442721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400acb86-1f18-4b63-8417-87ca003a787e-tmp\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.443105 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.442790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flx8\" (UniqueName: \"kubernetes.io/projected/400acb86-1f18-4b63-8417-87ca003a787e-kube-api-access-7flx8\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.443321 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.443210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/400acb86-1f18-4b63-8417-87ca003a787e-tmp\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.445429 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.445410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/400acb86-1f18-4b63-8417-87ca003a787e-klusterlet-config\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.454676 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.454612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flx8\" (UniqueName: \"kubernetes.io/projected/400acb86-1f18-4b63-8417-87ca003a787e-kube-api-access-7flx8\") pod \"klusterlet-addon-workmgr-698788ff5b-4c9h6\" (UID: \"400acb86-1f18-4b63-8417-87ca003a787e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.511403 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.511373    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:51:54.621375 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.621333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h48lk" event={"ID":"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae","Type":"ContainerStarted","Data":"ec7953dd737db15f838d09c09ab9da1783050fb3bd0bf25cdbbc5231d18e82ff"}
Jul 09 16:51:54.648068 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:54.648038    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"]
Jul 09 16:51:54.651438 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:54.651407    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400acb86_1f18_4b63_8417_87ca003a787e.slice/crio-a8ea92754de44394244bc358c95818f38e4cea3c16bb276ade6c02b8ad527370 WatchSource:0}: Error finding container a8ea92754de44394244bc358c95818f38e4cea3c16bb276ade6c02b8ad527370: Status 404 returned error can't find the container with id a8ea92754de44394244bc358c95818f38e4cea3c16bb276ade6c02b8ad527370
Jul 09 16:51:55.184610 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.184582    2570 scope.go:117] "RemoveContainer" containerID="abae5f1ab39483bda16a65d1cf260543c7d682ada1b0a2faaecfb267aa72e7f6"
Jul 09 16:51:55.352615 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.352111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:55.352615 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.352186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:55.352959 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.352942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c35b51d-1e89-414c-aabb-e207e27e4af6-service-ca-bundle\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:55.355670 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.355642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c35b51d-1e89-414c-aabb-e207e27e4af6-metrics-certs\") pod \"router-default-656b79498-fhh6t\" (UID: \"4c35b51d-1e89-414c-aabb-e207e27e4af6\") " pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:55.453755 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.453668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:55.453755 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.453722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:55.454287 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.453768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:55.457958 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.457918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72e7e3d9-e930-4b7a-8ab0-3213a2179bbc-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xmtd\" (UID: \"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:55.459622 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.459563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb3fc3ea-0f26-42b2-8e85-30666d3ab281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wd84b\" (UID: \"eb3fc3ea-0f26-42b2-8e85-30666d3ab281\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:55.461110 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.461064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e763fcec-bad5-4349-b5a0-e52721a9a423-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zvtvw\" (UID: \"e763fcec-bad5-4349-b5a0-e52721a9a423\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:55.571846 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.571794    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jl8qg\""
Jul 09 16:51:55.579412 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.579160    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:55.624434 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.624403    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2lqv4\""
Jul 09 16:51:55.632647 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.630795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6" event={"ID":"400acb86-1f18-4b63-8417-87ca003a787e","Type":"ContainerStarted","Data":"a8ea92754de44394244bc358c95818f38e4cea3c16bb276ade6c02b8ad527370"}
Jul 09 16:51:55.632647 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.632432    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"
Jul 09 16:51:55.635817 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.635797    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 16:51:55.636042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.636022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mrvdr" event={"ID":"5147479c-6df1-4a9f-83c2-563a015f1670","Type":"ContainerStarted","Data":"d5c679442ee5245ad37309eb4e41ee8bcc9716ab182e11db784b3d98c797aa52"}
Jul 09 16:51:55.637153 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.637137    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:55.646677 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.646657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kl2rq\""
Jul 09 16:51:55.655087 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.655068    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"
Jul 09 16:51:55.710315 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.709989    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5vlb4\""
Jul 09 16:51:55.717662 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:55.717502    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"
Jul 09 16:51:56.262289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.261989    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw"]
Jul 09 16:51:56.281597 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.281570    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xmtd"]
Jul 09 16:51:56.308733 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.308600    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-656b79498-fhh6t"]
Jul 09 16:51:56.349741 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.349658    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b"]
Jul 09 16:51:56.638051 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.637711    2570 patch_prober.go:28] interesting pod/console-operator-7866497494-mrvdr container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 16:51:56.638051 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.637773    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-mrvdr" podUID="5147479c-6df1-4a9f-83c2-563a015f1670" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 16:51:56.645388 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.645355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nlhj" event={"ID":"f1403ef1-99fe-4e7f-8193-45884c314367","Type":"ContainerStarted","Data":"6e381fb2e3744ab219a9319bfcac02e66d7284f4d230fe7e62e5a5da3399e40d"}
Jul 09 16:51:56.678738 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:56.678707    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-mrvdr"
Jul 09 16:51:57.236892 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:51:57.236848    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c35b51d_1e89_414c_aabb_e207e27e4af6.slice/crio-ef3c64fa734423c070a777fbca58c82d682c5dace5b8c7101ec7f2cf1b7c1923 WatchSource:0}: Error finding container ef3c64fa734423c070a777fbca58c82d682c5dace5b8c7101ec7f2cf1b7c1923: Status 404 returned error can't find the container with id ef3c64fa734423c070a777fbca58c82d682c5dace5b8c7101ec7f2cf1b7c1923
Jul 09 16:51:57.649845 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.649782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd" event={"ID":"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc","Type":"ContainerStarted","Data":"f45351e67727536e9223c3184df03db692111cc796d0642f4d4b94f601e780c4"}
Jul 09 16:51:57.651590 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.651549    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-656b79498-fhh6t" event={"ID":"4c35b51d-1e89-414c-aabb-e207e27e4af6","Type":"ContainerStarted","Data":"4d6459d96a17d992985825bedd92099da2e126d280eb4036c40d811b02bb3f68"}
Jul 09 16:51:57.651727 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.651600    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-656b79498-fhh6t" event={"ID":"4c35b51d-1e89-414c-aabb-e207e27e4af6","Type":"ContainerStarted","Data":"ef3c64fa734423c070a777fbca58c82d682c5dace5b8c7101ec7f2cf1b7c1923"}
Jul 09 16:51:57.652885 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.652858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw" event={"ID":"e763fcec-bad5-4349-b5a0-e52721a9a423","Type":"ContainerStarted","Data":"9cc1351ff9e25e52dead1de5f9a8f714e032444bd48b3a09d61c42eca32edef9"}
Jul 09 16:51:57.654789 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.654765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nlhj" event={"ID":"f1403ef1-99fe-4e7f-8193-45884c314367","Type":"ContainerStarted","Data":"fc27a0b7f2274c5af01660ceb4ef2e60e19e8293de4d26e7b92faccfeec8e581"}
Jul 09 16:51:57.654921 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.654901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:51:57.656065 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.656040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b" event={"ID":"eb3fc3ea-0f26-42b2-8e85-30666d3ab281","Type":"ContainerStarted","Data":"94d72b2627ac74220efb71ce96226f2216103b5f69040b17f56809017e4e221b"}
Jul 09 16:51:57.675156 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.675099    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-656b79498-fhh6t" podStartSLOduration=34.675084258 podStartE2EDuration="34.675084258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:57.67449576 +0000 UTC m=+77.007956875" watchObservedRunningTime="2026-07-09 16:51:57.675084258 +0000 UTC m=+77.008545371"
Jul 09 16:51:57.696235 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:57.696180    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5nlhj" podStartSLOduration=38.058009107 podStartE2EDuration="40.696161998s" totalImagesPullingTime="2.638152891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:57.695568868 +0000 UTC m=+77.029030006" watchObservedRunningTime="2026-07-09 16:51:57.696161998 +0000 UTC m=+77.029623113"
Jul 09 16:51:58.580439 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:58.580402    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:58.583242 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:58.583213    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:58.660873 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:58.660816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:51:58.662168 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:51:58.662149    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-656b79498-fhh6t"
Jul 09 16:52:02.679271 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.679221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b" event={"ID":"eb3fc3ea-0f26-42b2-8e85-30666d3ab281","Type":"ContainerStarted","Data":"f36fa98167259f9ca6d1052fcb34ac3769bd0756a3d610ededa5585db96c0989"}
Jul 09 16:52:02.680864 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.680811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd" event={"ID":"72e7e3d9-e930-4b7a-8ab0-3213a2179bbc","Type":"ContainerStarted","Data":"e89ec1ff82ff5b1b5d33311312a714662baa26caac17375be688fcaeb7dc0a44"}
Jul 09 16:52:02.682737 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.682706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw" event={"ID":"e763fcec-bad5-4349-b5a0-e52721a9a423","Type":"ContainerStarted","Data":"ea09e56e74734c5d02803d48618af701fa909a121d4c27fd56a037c70342fd5e"}
Jul 09 16:52:02.682854 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.682759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw" event={"ID":"e763fcec-bad5-4349-b5a0-e52721a9a423","Type":"ContainerStarted","Data":"b0b029451722573e984bc380826e23ab794cb0928f2ea50e7eb45a074a8c4b69"}
Jul 09 16:52:02.685081 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.685058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h48lk" event={"ID":"e24b974f-d9f5-4ab9-8d54-0ec6a41590ae","Type":"ContainerStarted","Data":"d9b602ff061d2b71d0848430f626a84b29327cd91735a615eef80e3093da15a7"}
Jul 09 16:52:02.686506 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.686484    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6" event={"ID":"400acb86-1f18-4b63-8417-87ca003a787e","Type":"ContainerStarted","Data":"b0f42d2d5023d08123c626dfb27cb588f9c7ae7cf111ff270078d5c99841f095"}
Jul 09 16:52:02.686661 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.686647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:52:02.688279 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.688261    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6"
Jul 09 16:52:02.699927 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.699874    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b" podStartSLOduration=35.793089095 podStartE2EDuration="39.699855975s" totalImagesPullingTime="3.90676688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:02.699300327 +0000 UTC m=+82.032761461" watchObservedRunningTime="2026-07-09 16:52:02.699855975 +0000 UTC m=+82.033317090"
Jul 09 16:52:02.724631 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.724566    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xmtd" podStartSLOduration=34.654091117 podStartE2EDuration="39.724543309s" totalImagesPullingTime="5.070452192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:02.723197785 +0000 UTC m=+82.056658927" watchObservedRunningTime="2026-07-09 16:52:02.724543309 +0000 UTC m=+82.058004425"
Jul 09 16:52:02.764933 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.764851    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-698788ff5b-4c9h6" podStartSLOduration=2.268214326 podStartE2EDuration="8.764815722s" totalImagesPullingTime="6.496601396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:02.763501869 +0000 UTC m=+82.096962984" watchObservedRunningTime="2026-07-09 16:52:02.764815722 +0000 UTC m=+82.098276842"
Jul 09 16:52:02.765576 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:02.765548    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zvtvw" podStartSLOduration=34.779590994 podStartE2EDuration="39.765537095s" totalImagesPullingTime="4.985946101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:02.742722528 +0000 UTC m=+82.076183643" watchObservedRunningTime="2026-07-09 16:52:02.765537095 +0000 UTC m=+82.098998210"
Jul 09 16:52:07.663368 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:07.663241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5nlhj"
Jul 09 16:52:07.682780 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:07.682735    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h48lk" podStartSLOduration=23.104685147 podStartE2EDuration="36.682718344s" totalImagesPullingTime="13.578033197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:02.787263664 +0000 UTC m=+82.120724810" watchObservedRunningTime="2026-07-09 16:52:07.682718344 +0000 UTC m=+87.016179458"
Jul 09 16:52:14.625611 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:14.625585    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:52:16.817667 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:16.817629    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:52:18.594950 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:18.594917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fgfm2"
Jul 09 16:52:27.775475 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:27.775447    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 16:52:27.775920 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:27.775491    2570 generic.go:356] "Generic (PLEG): container finished" podID="eb3fc3ea-0f26-42b2-8e85-30666d3ab281" containerID="f36fa98167259f9ca6d1052fcb34ac3769bd0756a3d610ededa5585db96c0989" exitCode=2
Jul 09 16:52:27.775920 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:27.775572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b" event={"ID":"eb3fc3ea-0f26-42b2-8e85-30666d3ab281","Type":"ContainerDied","Data":"f36fa98167259f9ca6d1052fcb34ac3769bd0756a3d610ededa5585db96c0989"}
Jul 09 16:52:27.776005 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:27.775927    2570 scope.go:117] "RemoveContainer" containerID="f36fa98167259f9ca6d1052fcb34ac3769bd0756a3d610ededa5585db96c0989"
Jul 09 16:52:28.780947 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:28.780916    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 16:52:28.781323 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:28.781015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wd84b" event={"ID":"eb3fc3ea-0f26-42b2-8e85-30666d3ab281","Type":"ContainerStarted","Data":"854b13d04943a4b3da7efef4a7dde41e5cfa47f988dbfb96211455a25441b451"}
Jul 09 16:52:31.502897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.502861    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qb59b"]
Jul 09 16:52:31.584169 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.584135    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.587015 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.586989    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 16:52:31.587183 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.587028    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 16:52:31.587183 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.587050    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 16:52:31.587183 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.587048    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 16:52:31.588009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.587992    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b9wdr\""
Jul 09 16:52:31.641216 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-sys\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641321 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641221    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-textfile\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641321 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641275    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641321 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641422 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-root\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641422 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg6mt\" (UniqueName: \"kubernetes.io/projected/e60fd2df-9919-43e4-94d2-918a33478b42-kube-api-access-qg6mt\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641422 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-accelerators-collector-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641511 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-metrics-client-ca\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.641511 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.641472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-wtmp\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742601 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-wtmp\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-sys\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742670    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-sys\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-textfile\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-wtmp\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.742765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-root\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742781    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e60fd2df-9919-43e4-94d2-918a33478b42-root\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6mt\" (UniqueName: \"kubernetes.io/projected/e60fd2df-9919-43e4-94d2-918a33478b42-kube-api-access-qg6mt\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-accelerators-collector-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:52:31.742876    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.742925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-metrics-client-ca\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743076 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:52:31.742944    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls podName:e60fd2df-9919-43e4-94d2-918a33478b42 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:32.242925292 +0000 UTC m=+111.576386391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls") pod "node-exporter-qb59b" (UID: "e60fd2df-9919-43e4-94d2-918a33478b42") : secret "node-exporter-tls" not found
Jul 09 16:52:31.743303 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.743142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-textfile\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743485 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.743465    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-metrics-client-ca\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.743531 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.743482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-accelerators-collector-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.745616 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.745600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:31.751587 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:31.751564    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg6mt\" (UniqueName: \"kubernetes.io/projected/e60fd2df-9919-43e4-94d2-918a33478b42-kube-api-access-qg6mt\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:32.247032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:32.246995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:32.249369 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:32.249345    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e60fd2df-9919-43e4-94d2-918a33478b42-node-exporter-tls\") pod \"node-exporter-qb59b\" (UID: \"e60fd2df-9919-43e4-94d2-918a33478b42\") " pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:32.493747 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:32.493714    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qb59b"
Jul 09 16:52:32.517874 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:52:32.517823    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60fd2df_9919_43e4_94d2_918a33478b42.slice/crio-81e52f92f60bb02669dd77882c762d879594cbc53a067b70985a4a93ddaf12f6 WatchSource:0}: Error finding container 81e52f92f60bb02669dd77882c762d879594cbc53a067b70985a4a93ddaf12f6: Status 404 returned error can't find the container with id 81e52f92f60bb02669dd77882c762d879594cbc53a067b70985a4a93ddaf12f6
Jul 09 16:52:32.797264 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:32.797176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qb59b" event={"ID":"e60fd2df-9919-43e4-94d2-918a33478b42","Type":"ContainerStarted","Data":"81e52f92f60bb02669dd77882c762d879594cbc53a067b70985a4a93ddaf12f6"}
Jul 09 16:52:34.805458 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:34.805419    2570 generic.go:356] "Generic (PLEG): container finished" podID="e60fd2df-9919-43e4-94d2-918a33478b42" containerID="edc7c96abb1a806fe0f0c4c2d805e09ae87fecf56b9eae34b44d73ee13c72002" exitCode=0
Jul 09 16:52:34.805896 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:34.805472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qb59b" event={"ID":"e60fd2df-9919-43e4-94d2-918a33478b42","Type":"ContainerDied","Data":"edc7c96abb1a806fe0f0c4c2d805e09ae87fecf56b9eae34b44d73ee13c72002"}
Jul 09 16:52:35.811326 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:35.811289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qb59b" event={"ID":"e60fd2df-9919-43e4-94d2-918a33478b42","Type":"ContainerStarted","Data":"f65acfbc440e75181754cc65cef6a4229635bf9fec2481a5df99a8357785298b"}
Jul 09 16:52:35.811721 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:35.811349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qb59b" event={"ID":"e60fd2df-9919-43e4-94d2-918a33478b42","Type":"ContainerStarted","Data":"c38625e6c12153d699ea7ccb44af2b9dc4bd49cf41fba57f8bdd9cdf6abea623"}
Jul 09 16:52:35.831908 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:35.831858    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qb59b" podStartSLOduration=3.298107169 podStartE2EDuration="4.831841538s" totalImagesPullingTime="1.426211168s" totalInitContainerRuntime="107.523201ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:35.829519603 +0000 UTC m=+115.162980728" watchObservedRunningTime="2026-07-09 16:52:35.831841538 +0000 UTC m=+115.165302642"
Jul 09 16:52:41.831778 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:41.831743    2570 generic.go:356] "Generic (PLEG): container finished" podID="52a1fd8c-77d3-4436-a1d6-e24b1bf057e7" containerID="7dbc39fa0afcabcd3f3b68616dea2408f8bda47e464c540ae74971ca796af0f1" exitCode=0
Jul 09 16:52:41.832175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:41.831798    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l" event={"ID":"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7","Type":"ContainerDied","Data":"7dbc39fa0afcabcd3f3b68616dea2408f8bda47e464c540ae74971ca796af0f1"}
Jul 09 16:52:41.832175 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:41.832100    2570 scope.go:117] "RemoveContainer" containerID="7dbc39fa0afcabcd3f3b68616dea2408f8bda47e464c540ae74971ca796af0f1"
Jul 09 16:52:41.837898 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:41.837866    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" podUID="b6f28040-5046-4c61-94d7-96ca0422fad7" containerName="registry" containerID="cri-o://822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494" gracePeriod=30
Jul 09 16:52:42.112969 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.112947    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:52:42.227415 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227415 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227417    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227450    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227477    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227507    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227528    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227545    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227576    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlx59\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59\") pod \"b6f28040-5046-4c61-94d7-96ca0422fad7\" (UID: \"b6f28040-5046-4c61-94d7-96ca0422fad7\") "
Jul 09 16:52:42.227979 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:52:42.227979 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.227956    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 16:52:42.230373 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.230321    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:52:42.230520 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.230368    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:52:42.230520 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.230491    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:52:42.230638 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.230523    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 16:52:42.230693 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.230663    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59" (OuterVolumeSpecName: "kube-api-access-xlx59") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "kube-api-access-xlx59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:52:42.236265 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.236240    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b6f28040-5046-4c61-94d7-96ca0422fad7" (UID: "b6f28040-5046-4c61-94d7-96ca0422fad7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:52:42.328675 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328645    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlx59\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-kube-api-access-xlx59\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328675 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328671    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-trusted-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328675 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328680    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-bound-sa-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328934 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328688    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328934 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328697    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-image-registry-private-configuration\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328934 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328706    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6f28040-5046-4c61-94d7-96ca0422fad7-ca-trust-extracted\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328934 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328714    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6f28040-5046-4c61-94d7-96ca0422fad7-registry-certificates\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.328934 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.328722    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6f28040-5046-4c61-94d7-96ca0422fad7-installation-pull-secrets\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:52:42.841218 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.841180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-46p8l" event={"ID":"52a1fd8c-77d3-4436-a1d6-e24b1bf057e7","Type":"ContainerStarted","Data":"8992f7acc07be84dfb27b96abce9296358d1533dcc0b66fae0d68a12822ba7ac"}
Jul 09 16:52:42.842402 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.842376    2570 generic.go:356] "Generic (PLEG): container finished" podID="b6f28040-5046-4c61-94d7-96ca0422fad7" containerID="822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494" exitCode=0
Jul 09 16:52:42.842536 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.842414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" event={"ID":"b6f28040-5046-4c61-94d7-96ca0422fad7","Type":"ContainerDied","Data":"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"}
Jul 09 16:52:42.842536 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.842432    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh"
Jul 09 16:52:42.842536 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.842450    2570 scope.go:117] "RemoveContainer" containerID="822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"
Jul 09 16:52:42.842687 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.842441    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bc5cf7f9-72thh" event={"ID":"b6f28040-5046-4c61-94d7-96ca0422fad7","Type":"ContainerDied","Data":"ae40944c76419b6fe0fb8c1ea75ec8c6397882234fd9e81a867169f614c4d376"}
Jul 09 16:52:42.852396 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.852156    2570 scope.go:117] "RemoveContainer" containerID="822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"
Jul 09 16:52:42.854056 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:52:42.854022    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494\": container with ID starting with 822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494 not found: ID does not exist" containerID="822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"
Jul 09 16:52:42.854152 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.854059    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494"} err="failed to get container status \"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494\": rpc error: code = NotFound desc = could not find container \"822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494\": container with ID starting with 822bd8938b021a1de11501d0a3f4570712dbda67c647ff901f349f2c43ecf494 not found: ID does not exist"
Jul 09 16:52:42.870263 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.870237    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:52:42.876477 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:42.876452    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56bc5cf7f9-72thh"]
Jul 09 16:52:43.187633 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:43.187589    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f28040-5046-4c61-94d7-96ca0422fad7" path="/var/lib/kubelet/pods/b6f28040-5046-4c61-94d7-96ca0422fad7/volumes"
Jul 09 16:52:50.894109 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:50.894068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:52:50.896414 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:50.896392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b703ef6-819e-4f10-8e6e-bcbd45aea824-metrics-certs\") pod \"network-metrics-daemon-82qqg\" (UID: \"3b703ef6-819e-4f10-8e6e-bcbd45aea824\") " pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:52:51.096946 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.096918    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tqb9\""
Jul 09 16:52:51.104430 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.104411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qqg"
Jul 09 16:52:51.233362 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.233333    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82qqg"]
Jul 09 16:52:51.235599 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:52:51.235568    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b703ef6_819e_4f10_8e6e_bcbd45aea824.slice/crio-76b674e7b25807173f481f47c44b328e7a44cf2df097e65b3474624ea408e6d1 WatchSource:0}: Error finding container 76b674e7b25807173f481f47c44b328e7a44cf2df097e65b3474624ea408e6d1: Status 404 returned error can't find the container with id 76b674e7b25807173f481f47c44b328e7a44cf2df097e65b3474624ea408e6d1
Jul 09 16:52:51.875789 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.875756    2570 generic.go:356] "Generic (PLEG): container finished" podID="233cc2e5-3a05-4b06-9fff-5ef1aa10362f" containerID="17d392d40fdcadbd4bb6058c8bfc2a77158b907a8a7813b3bbc8b7a8a046ecbc" exitCode=0
Jul 09 16:52:51.875995 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.875845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p" event={"ID":"233cc2e5-3a05-4b06-9fff-5ef1aa10362f","Type":"ContainerDied","Data":"17d392d40fdcadbd4bb6058c8bfc2a77158b907a8a7813b3bbc8b7a8a046ecbc"}
Jul 09 16:52:51.876184 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.876167    2570 scope.go:117] "RemoveContainer" containerID="17d392d40fdcadbd4bb6058c8bfc2a77158b907a8a7813b3bbc8b7a8a046ecbc"
Jul 09 16:52:51.877098 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:51.877071    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qqg" event={"ID":"3b703ef6-819e-4f10-8e6e-bcbd45aea824","Type":"ContainerStarted","Data":"76b674e7b25807173f481f47c44b328e7a44cf2df097e65b3474624ea408e6d1"}
Jul 09 16:52:52.883719 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:52.883677    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ffq9p" event={"ID":"233cc2e5-3a05-4b06-9fff-5ef1aa10362f","Type":"ContainerStarted","Data":"836d914365b264701e4b82afc10381fa91a0fc46a1cbba0f39319e6755dc283a"}
Jul 09 16:52:53.888710 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:53.888671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qqg" event={"ID":"3b703ef6-819e-4f10-8e6e-bcbd45aea824","Type":"ContainerStarted","Data":"88eec62992f1df17f5436f935aa96e86c1c17f391fabce09ebab8f8812d41d66"}
Jul 09 16:52:53.889247 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:53.888731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qqg" event={"ID":"3b703ef6-819e-4f10-8e6e-bcbd45aea824","Type":"ContainerStarted","Data":"7968592073d01522f80e52b0910c8b8bbcff902f7e3f80653e21c6235784d24c"}
Jul 09 16:52:53.906379 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:52:53.906328    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82qqg" podStartSLOduration=131.156303984 podStartE2EDuration="2m12.906313419s" totalImagesPullingTime="1.750009435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:53.904965283 +0000 UTC m=+133.238426418" watchObservedRunningTime="2026-07-09 16:52:53.906313419 +0000 UTC m=+133.239774594"
Jul 09 16:53:00.918233 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:53:00.918200    2570 generic.go:356] "Generic (PLEG): container finished" podID="b0c063fa-cfe0-4db5-b346-95fa68c4f678" containerID="06056641e1c2af546a4ce86aaf67fece1b9c6f022bdd95e7a84852761aec0ab0" exitCode=0
Jul 09 16:53:00.918593 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:53:00.918279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8" event={"ID":"b0c063fa-cfe0-4db5-b346-95fa68c4f678","Type":"ContainerDied","Data":"06056641e1c2af546a4ce86aaf67fece1b9c6f022bdd95e7a84852761aec0ab0"}
Jul 09 16:53:00.918660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:53:00.918646    2570 scope.go:117] "RemoveContainer" containerID="06056641e1c2af546a4ce86aaf67fece1b9c6f022bdd95e7a84852761aec0ab0"
Jul 09 16:53:01.923290 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:53:01.923257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nr7t8" event={"ID":"b0c063fa-cfe0-4db5-b346-95fa68c4f678","Type":"ContainerStarted","Data":"b8cc9985d1c78b65b4fde73c75986d425cbeee21b760c01a2ac76caaba78470d"}
Jul 09 16:54:59.230756 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.230715    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"]
Jul 09 16:54:59.231236 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.231049    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f28040-5046-4c61-94d7-96ca0422fad7" containerName="registry"
Jul 09 16:54:59.231236 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.231063    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f28040-5046-4c61-94d7-96ca0422fad7" containerName="registry"
Jul 09 16:54:59.231236 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.231130    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f28040-5046-4c61-94d7-96ca0422fad7" containerName="registry"
Jul 09 16:54:59.234282 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.234263    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.237389 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.237365    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 16:54:59.237526 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.237365    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 16:54:59.238452 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.238433    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bv82b\""
Jul 09 16:54:59.246871 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.246849    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"]
Jul 09 16:54:59.265435 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.265409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.265530 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.265459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxpzn\" (UniqueName: \"kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.265530 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.265520    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.366248 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.366212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxpzn\" (UniqueName: \"kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.366421 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.366279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.366421 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.366328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.366658 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.366639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.366702 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.366687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.377233 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.377201    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxpzn\" (UniqueName: \"kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.544318 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.544218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:54:59.674482 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:54:59.674304    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"]
Jul 09 16:54:59.677179 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:54:59.677151    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ad561_02cc_4c86_9348_b02e26738309.slice/crio-9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a WatchSource:0}: Error finding container 9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a: Status 404 returned error can't find the container with id 9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a
Jul 09 16:55:00.344818 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:00.344787    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq" event={"ID":"3d5ad561-02cc-4c86-9348-b02e26738309","Type":"ContainerStarted","Data":"9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a"}
Jul 09 16:55:08.375825 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:08.375784    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d5ad561-02cc-4c86-9348-b02e26738309" containerID="e9d6b08fdf5c2630a59f4af2619336699ff9d12998055432a0b9967e13b911ea" exitCode=0
Jul 09 16:55:08.376231 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:08.375873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq" event={"ID":"3d5ad561-02cc-4c86-9348-b02e26738309","Type":"ContainerDied","Data":"e9d6b08fdf5c2630a59f4af2619336699ff9d12998055432a0b9967e13b911ea"}
Jul 09 16:55:10.385220 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:10.385187    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d5ad561-02cc-4c86-9348-b02e26738309" containerID="b596880e2c3d339b239880dc783a17f52817489f0a36d949fa6030cdbd8db60a" exitCode=0
Jul 09 16:55:10.385589 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:10.385275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq" event={"ID":"3d5ad561-02cc-4c86-9348-b02e26738309","Type":"ContainerDied","Data":"b596880e2c3d339b239880dc783a17f52817489f0a36d949fa6030cdbd8db60a"}
Jul 09 16:55:18.419066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:18.419025    2570 generic.go:356] "Generic (PLEG): container finished" podID="3d5ad561-02cc-4c86-9348-b02e26738309" containerID="b08eb7edcd86d09e8fff3936cbde38ad8f1746207bf1799e0aa953af3d3cd953" exitCode=0
Jul 09 16:55:18.419440 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:18.419117    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq" event={"ID":"3d5ad561-02cc-4c86-9348-b02e26738309","Type":"ContainerDied","Data":"b08eb7edcd86d09e8fff3936cbde38ad8f1746207bf1799e0aa953af3d3cd953"}
Jul 09 16:55:19.547215 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.547193    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:55:19.635819 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.635791    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util\") pod \"3d5ad561-02cc-4c86-9348-b02e26738309\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") "
Jul 09 16:55:19.635990 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.635896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle\") pod \"3d5ad561-02cc-4c86-9348-b02e26738309\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") "
Jul 09 16:55:19.635990 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.635942    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxpzn\" (UniqueName: \"kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn\") pod \"3d5ad561-02cc-4c86-9348-b02e26738309\" (UID: \"3d5ad561-02cc-4c86-9348-b02e26738309\") "
Jul 09 16:55:19.636543 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.636516    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle" (OuterVolumeSpecName: "bundle") pod "3d5ad561-02cc-4c86-9348-b02e26738309" (UID: "3d5ad561-02cc-4c86-9348-b02e26738309"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:19.638059 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.638036    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn" (OuterVolumeSpecName: "kube-api-access-jxpzn") pod "3d5ad561-02cc-4c86-9348-b02e26738309" (UID: "3d5ad561-02cc-4c86-9348-b02e26738309"). InnerVolumeSpecName "kube-api-access-jxpzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:55:19.639840 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.639810    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util" (OuterVolumeSpecName: "util") pod "3d5ad561-02cc-4c86-9348-b02e26738309" (UID: "3d5ad561-02cc-4c86-9348-b02e26738309"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:19.737067 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.736986    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:19.737067 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.737013    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d5ad561-02cc-4c86-9348-b02e26738309-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:19.737067 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:19.737024    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxpzn\" (UniqueName: \"kubernetes.io/projected/3d5ad561-02cc-4c86-9348-b02e26738309-kube-api-access-jxpzn\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:20.428510 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:20.428425    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq" event={"ID":"3d5ad561-02cc-4c86-9348-b02e26738309","Type":"ContainerDied","Data":"9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a"}
Jul 09 16:55:20.428510 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:20.428448    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409prqq"
Jul 09 16:55:20.428510 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:20.428485    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9566303554e52ec5181878c4cb6fff0f85f59369b585d8dbdb9c64ab138a8a4a"
Jul 09 16:55:27.251017 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.250985    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"]
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251369    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="util"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251384    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="util"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251407    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="pull"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251412    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="pull"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251422    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="extract"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251429    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="extract"
Jul 09 16:55:27.251487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.251491    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5ad561-02cc-4c86-9348-b02e26738309" containerName="extract"
Jul 09 16:55:27.254955 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.254936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.258858 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.258821    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 16:55:27.258981 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.258962    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-89tmr\""
Jul 09 16:55:27.259048 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.259033    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 16:55:27.277641 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.277606    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"]
Jul 09 16:55:27.400359 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.400318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6jdf\" (UniqueName: \"kubernetes.io/projected/d8777748-8307-46a7-9f82-6c86a787868d-kube-api-access-t6jdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.400541 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.400379    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8777748-8307-46a7-9f82-6c86a787868d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.501149 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.501056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8777748-8307-46a7-9f82-6c86a787868d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.501302 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.501204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6jdf\" (UniqueName: \"kubernetes.io/projected/d8777748-8307-46a7-9f82-6c86a787868d-kube-api-access-t6jdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.501460 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.501439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8777748-8307-46a7-9f82-6c86a787868d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.513172 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.513142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6jdf\" (UniqueName: \"kubernetes.io/projected/d8777748-8307-46a7-9f82-6c86a787868d-kube-api-access-t6jdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2svh\" (UID: \"d8777748-8307-46a7-9f82-6c86a787868d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.564066 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.564038    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"
Jul 09 16:55:27.698120 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:27.698086    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh"]
Jul 09 16:55:27.701166 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:55:27.701140    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8777748_8307_46a7_9f82_6c86a787868d.slice/crio-a04ed0af5a8e88cb58d59121e5e12ec3c06c9b5139a1bf617fea15656b0d01b0 WatchSource:0}: Error finding container a04ed0af5a8e88cb58d59121e5e12ec3c06c9b5139a1bf617fea15656b0d01b0: Status 404 returned error can't find the container with id a04ed0af5a8e88cb58d59121e5e12ec3c06c9b5139a1bf617fea15656b0d01b0
Jul 09 16:55:28.460218 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:28.460183    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh" event={"ID":"d8777748-8307-46a7-9f82-6c86a787868d","Type":"ContainerStarted","Data":"a04ed0af5a8e88cb58d59121e5e12ec3c06c9b5139a1bf617fea15656b0d01b0"}
Jul 09 16:55:29.466044 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:29.465999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh" event={"ID":"d8777748-8307-46a7-9f82-6c86a787868d","Type":"ContainerStarted","Data":"a40fd02b03650e336ac1318f09596de00607f8eb71fc6d7e66954732da95053e"}
Jul 09 16:55:29.492223 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:29.492116    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2svh" podStartSLOduration=0.966114633 podStartE2EDuration="2.492100259s" totalImagesPullingTime="1.525985626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:29.490039542 +0000 UTC m=+288.823500675" watchObservedRunningTime="2026-07-09 16:55:29.492100259 +0000 UTC m=+288.825561372"
Jul 09 16:55:30.969110 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.969077    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"]
Jul 09 16:55:30.971366 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.971347    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:30.974350 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.974327    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 16:55:30.975686 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.975665    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 16:55:30.975780 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.975690    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bv82b\""
Jul 09 16:55:30.981983 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:30.981962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"]
Jul 09 16:55:31.133530 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.133492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7r2\" (UniqueName: \"kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.133689 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.133536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.133689 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.133624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.234227 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.234152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.234227 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.234202    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7r2\" (UniqueName: \"kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.234227 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.234226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.234536 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.234517    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.234574 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.234531    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.243021 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.243000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7r2\" (UniqueName: \"kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.280600 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.280571    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:31.419150 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.419006    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"]
Jul 09 16:55:31.421616 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:55:31.421585    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b57df0_4edc_4db5_83dc_46102638c0bb.slice/crio-b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854 WatchSource:0}: Error finding container b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854: Status 404 returned error can't find the container with id b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854
Jul 09 16:55:31.475301 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:31.475275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9" event={"ID":"02b57df0-4edc-4db5-83dc-46102638c0bb","Type":"ContainerStarted","Data":"b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854"}
Jul 09 16:55:32.481072 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.481033    2570 generic.go:356] "Generic (PLEG): container finished" podID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerID="03d067a3f1a4c7db372a788661fb75b1f0f70e077e30d47994109a11b79e29c0" exitCode=0
Jul 09 16:55:32.481507 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.481129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9" event={"ID":"02b57df0-4edc-4db5-83dc-46102638c0bb","Type":"ContainerDied","Data":"03d067a3f1a4c7db372a788661fb75b1f0f70e077e30d47994109a11b79e29c0"}
Jul 09 16:55:32.914844 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.914797    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"]
Jul 09 16:55:32.917159 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.917138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:32.920104 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.920078    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 16:55:32.920220 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.920156    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 16:55:32.920349 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.920326    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-827qw\""
Jul 09 16:55:32.933152 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:32.933117    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"]
Jul 09 16:55:33.050335 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.050301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n7m\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-kube-api-access-d6n7m\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.050335 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.050348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.151089 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.151058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n7m\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-kube-api-access-d6n7m\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.151089 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.151104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.160552 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.160489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.160695 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.160675    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n7m\" (UniqueName: \"kubernetes.io/projected/451599ff-10ef-4bc5-aa14-ec3298c9b7da-kube-api-access-d6n7m\") pod \"cert-manager-cainjector-559cdd8c87-m7bck\" (UID: \"451599ff-10ef-4bc5-aa14-ec3298c9b7da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.239676 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.239592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"
Jul 09 16:55:33.386455 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.386413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7bck"]
Jul 09 16:55:33.389203 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:55:33.389173    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod451599ff_10ef_4bc5_aa14_ec3298c9b7da.slice/crio-8cc0a572b56620d94792c8e945fd0bb0c86305035499b9e3cf4f6549f3dd9935 WatchSource:0}: Error finding container 8cc0a572b56620d94792c8e945fd0bb0c86305035499b9e3cf4f6549f3dd9935: Status 404 returned error can't find the container with id 8cc0a572b56620d94792c8e945fd0bb0c86305035499b9e3cf4f6549f3dd9935
Jul 09 16:55:33.487331 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:33.487289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck" event={"ID":"451599ff-10ef-4bc5-aa14-ec3298c9b7da","Type":"ContainerStarted","Data":"8cc0a572b56620d94792c8e945fd0bb0c86305035499b9e3cf4f6549f3dd9935"}
Jul 09 16:55:34.493986 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:34.493892    2570 generic.go:356] "Generic (PLEG): container finished" podID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerID="15d0fa1dfb2c3707822019ad46afae729de914ffc81b29b857df5fc51a91334f" exitCode=0
Jul 09 16:55:34.494408 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:34.493969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9" event={"ID":"02b57df0-4edc-4db5-83dc-46102638c0bb","Type":"ContainerDied","Data":"15d0fa1dfb2c3707822019ad46afae729de914ffc81b29b857df5fc51a91334f"}
Jul 09 16:55:35.501699 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:35.501661    2570 generic.go:356] "Generic (PLEG): container finished" podID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerID="d158097a094c31050f935b3c38c209c1bec275f48963cb28fb18763065f804ca" exitCode=0
Jul 09 16:55:35.502156 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:35.501732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9" event={"ID":"02b57df0-4edc-4db5-83dc-46102638c0bb","Type":"ContainerDied","Data":"d158097a094c31050f935b3c38c209c1bec275f48963cb28fb18763065f804ca"}
Jul 09 16:55:36.507868 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.507806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck" event={"ID":"451599ff-10ef-4bc5-aa14-ec3298c9b7da","Type":"ContainerStarted","Data":"daa8ab77be83d7693105de3a17d48708e09208d1f817afcf855921e4f8749adb"}
Jul 09 16:55:36.523452 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.523388    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7bck" podStartSLOduration=1.804402816 podStartE2EDuration="4.523368863s" totalImagesPullingTime="2.718966047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:36.523032971 +0000 UTC m=+295.856494086" watchObservedRunningTime="2026-07-09 16:55:36.523368863 +0000 UTC m=+295.856829977"
Jul 09 16:55:36.655426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.655402    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:36.783100 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.783010    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util\") pod \"02b57df0-4edc-4db5-83dc-46102638c0bb\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") "
Jul 09 16:55:36.783100 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.783069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle\") pod \"02b57df0-4edc-4db5-83dc-46102638c0bb\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") "
Jul 09 16:55:36.783100 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.783106    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn7r2\" (UniqueName: \"kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2\") pod \"02b57df0-4edc-4db5-83dc-46102638c0bb\" (UID: \"02b57df0-4edc-4db5-83dc-46102638c0bb\") "
Jul 09 16:55:36.783454 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.783423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle" (OuterVolumeSpecName: "bundle") pod "02b57df0-4edc-4db5-83dc-46102638c0bb" (UID: "02b57df0-4edc-4db5-83dc-46102638c0bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:36.785272 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.785248    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2" (OuterVolumeSpecName: "kube-api-access-xn7r2") pod "02b57df0-4edc-4db5-83dc-46102638c0bb" (UID: "02b57df0-4edc-4db5-83dc-46102638c0bb"). InnerVolumeSpecName "kube-api-access-xn7r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:55:36.787964 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.787943    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util" (OuterVolumeSpecName: "util") pod "02b57df0-4edc-4db5-83dc-46102638c0bb" (UID: "02b57df0-4edc-4db5-83dc-46102638c0bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:36.883568 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.883532    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn7r2\" (UniqueName: \"kubernetes.io/projected/02b57df0-4edc-4db5-83dc-46102638c0bb-kube-api-access-xn7r2\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:36.883568 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.883561    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:36.883568 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:36.883573    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02b57df0-4edc-4db5-83dc-46102638c0bb-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:37.514157 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:37.514065    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9"
Jul 09 16:55:37.514157 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:37.514089    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxv9z9" event={"ID":"02b57df0-4edc-4db5-83dc-46102638c0bb","Type":"ContainerDied","Data":"b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854"}
Jul 09 16:55:37.514157 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:37.514153    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b22c66480e38a3e916674f1024c9ebcd97b1c707c2a9662a3066c2d527585854"
Jul 09 16:55:41.040889 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:41.040853    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 16:55:41.041343 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:41.041087    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 16:55:41.045864 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:41.045824    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 16:55:41.046207 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:41.046188    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 16:55:41.056485 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:41.056467    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 16:55:50.850088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850047    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"]
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850337    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="extract"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850348    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="extract"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850363    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="pull"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850369    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="pull"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850375    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="util"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850381    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="util"
Jul 09 16:55:50.872703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.850426    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="02b57df0-4edc-4db5-83dc-46102638c0bb" containerName="extract"
Jul 09 16:55:50.882682 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.882643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"]
Jul 09 16:55:50.882825 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.882751    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:50.885634 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.885611    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 16:55:50.886602 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.886578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bv82b\""
Jul 09 16:55:50.886660 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.886589    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 16:55:50.984091 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.984049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:50.984270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.984110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-979jr\" (UniqueName: \"kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:50.984270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:50.984180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.084535 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.084495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.084700 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.084551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-979jr\" (UniqueName: \"kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.084700 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.084598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.084917 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.084896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.084991 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.084969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.093291 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.093262    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-979jr\" (UniqueName: \"kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.191588 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.191560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:51.335329 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.335238    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"]
Jul 09 16:55:51.338261 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:55:51.338229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde29806_0349_4508_9ee8_5d28068c22d2.slice/crio-1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b WatchSource:0}: Error finding container 1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b: Status 404 returned error can't find the container with id 1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b
Jul 09 16:55:51.572653 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.572618    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde29806-0349-4508-9ee8-5d28068c22d2" containerID="4964795c291bfa3f92bedf9dae95113143204a3ddd50e94acdcd494e844ce6b1" exitCode=0
Jul 09 16:55:51.572862 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.572705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk" event={"ID":"fde29806-0349-4508-9ee8-5d28068c22d2","Type":"ContainerDied","Data":"4964795c291bfa3f92bedf9dae95113143204a3ddd50e94acdcd494e844ce6b1"}
Jul 09 16:55:51.572862 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.572803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk" event={"ID":"fde29806-0349-4508-9ee8-5d28068c22d2","Type":"ContainerStarted","Data":"1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b"}
Jul 09 16:55:51.573203 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.573188    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 16:55:51.794294 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.794212    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2t46z"]
Jul 09 16:55:51.815031 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.815003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.815031 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.815017    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2t46z"]
Jul 09 16:55:51.817516 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.817495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ldp6p\""
Jul 09 16:55:51.888915 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.888878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96qq4\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-kube-api-access-96qq4\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.889257 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.888949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.989431 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.989394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96qq4\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-kube-api-access-96qq4\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.989627 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.989469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.997498 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.997472    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:51.997625 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:51.997608    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96qq4\" (UniqueName: \"kubernetes.io/projected/2f9af9cd-506f-4fbb-91a2-6504ea62760f-kube-api-access-96qq4\") pod \"cert-manager-55b4d954d5-2t46z\" (UID: \"2f9af9cd-506f-4fbb-91a2-6504ea62760f\") " pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:52.123939 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:52.123905    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2t46z"
Jul 09 16:55:52.266074 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:52.265923    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2t46z"]
Jul 09 16:55:52.268600 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:55:52.268568    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f9af9cd_506f_4fbb_91a2_6504ea62760f.slice/crio-f44ce85c54bcdfe604df3d99e46b2320d5da8250606ded00909cdeeeb3d12258 WatchSource:0}: Error finding container f44ce85c54bcdfe604df3d99e46b2320d5da8250606ded00909cdeeeb3d12258: Status 404 returned error can't find the container with id f44ce85c54bcdfe604df3d99e46b2320d5da8250606ded00909cdeeeb3d12258
Jul 09 16:55:52.578971 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:52.578933    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2t46z" event={"ID":"2f9af9cd-506f-4fbb-91a2-6504ea62760f","Type":"ContainerStarted","Data":"3b6e80bf0bda4e853904a28a1e9f5bdd0fedd8c04e765faed4a320339ae02fdd"}
Jul 09 16:55:52.579138 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:52.578985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2t46z" event={"ID":"2f9af9cd-506f-4fbb-91a2-6504ea62760f","Type":"ContainerStarted","Data":"f44ce85c54bcdfe604df3d99e46b2320d5da8250606ded00909cdeeeb3d12258"}
Jul 09 16:55:52.595334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:52.595293    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2t46z" podStartSLOduration=1.595278835 podStartE2EDuration="1.595278835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:52.59382183 +0000 UTC m=+311.927282957" watchObservedRunningTime="2026-07-09 16:55:52.595278835 +0000 UTC m=+311.928739949"
Jul 09 16:55:53.584771 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:53.584738    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde29806-0349-4508-9ee8-5d28068c22d2" containerID="f38a5354723b7ba2315e570d13b48e9c7f582a506725bc5f65089c92dd30dd1b" exitCode=0
Jul 09 16:55:53.585191 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:53.584842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk" event={"ID":"fde29806-0349-4508-9ee8-5d28068c22d2","Type":"ContainerDied","Data":"f38a5354723b7ba2315e570d13b48e9c7f582a506725bc5f65089c92dd30dd1b"}
Jul 09 16:55:54.591005 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:54.590966    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde29806-0349-4508-9ee8-5d28068c22d2" containerID="e2c09f68b874bc80f754e4dfdf2694d64325754cd54183d91c44221bce5033c1" exitCode=0
Jul 09 16:55:54.591371 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:54.591053    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk" event={"ID":"fde29806-0349-4508-9ee8-5d28068c22d2","Type":"ContainerDied","Data":"e2c09f68b874bc80f754e4dfdf2694d64325754cd54183d91c44221bce5033c1"}
Jul 09 16:55:55.721141 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.721115    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:55.818155 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.818129    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-979jr\" (UniqueName: \"kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr\") pod \"fde29806-0349-4508-9ee8-5d28068c22d2\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") "
Jul 09 16:55:55.818342 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.818164    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle\") pod \"fde29806-0349-4508-9ee8-5d28068c22d2\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") "
Jul 09 16:55:55.818342 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.818205    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util\") pod \"fde29806-0349-4508-9ee8-5d28068c22d2\" (UID: \"fde29806-0349-4508-9ee8-5d28068c22d2\") "
Jul 09 16:55:55.818947 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.818916    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle" (OuterVolumeSpecName: "bundle") pod "fde29806-0349-4508-9ee8-5d28068c22d2" (UID: "fde29806-0349-4508-9ee8-5d28068c22d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:55.820266 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.820236    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr" (OuterVolumeSpecName: "kube-api-access-979jr") pod "fde29806-0349-4508-9ee8-5d28068c22d2" (UID: "fde29806-0349-4508-9ee8-5d28068c22d2"). InnerVolumeSpecName "kube-api-access-979jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:55:55.826713 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.826686    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util" (OuterVolumeSpecName: "util") pod "fde29806-0349-4508-9ee8-5d28068c22d2" (UID: "fde29806-0349-4508-9ee8-5d28068c22d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:55:55.919324 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.919280    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-979jr\" (UniqueName: \"kubernetes.io/projected/fde29806-0349-4508-9ee8-5d28068c22d2-kube-api-access-979jr\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:55.919324 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.919314    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:55.919324 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:55.919324    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fde29806-0349-4508-9ee8-5d28068c22d2-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:55:56.601089 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:56.601055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk" event={"ID":"fde29806-0349-4508-9ee8-5d28068c22d2","Type":"ContainerDied","Data":"1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b"}
Jul 09 16:55:56.601089 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:56.601087    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9swbk"
Jul 09 16:55:56.601283 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:55:56.601106    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c071ed60c308c63bed13cc61d03f8166bf4006c0008ad5458741c50b5fba26b"
Jul 09 16:56:08.021286 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021248    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"]
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021697    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="extract"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021716    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="extract"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021731    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="util"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021740    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="util"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021776    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="pull"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021785    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="pull"
Jul 09 16:56:08.021881 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.021882    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde29806-0349-4508-9ee8-5d28068c22d2" containerName="extract"
Jul 09 16:56:08.025289 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.025268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.029004 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.028980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 16:56:08.029548 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.029530    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 16:56:08.029931 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.029915    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2xv8\""
Jul 09 16:56:08.033246 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.033226    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 16:56:08.037713 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.037696    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 16:56:08.043405 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.043384    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"]
Jul 09 16:56:08.115241 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.115205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.115241 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.115241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqhf\" (UniqueName: \"kubernetes.io/projected/03be99aa-424c-4ced-8cc6-c21d58081fd9-kube-api-access-5hqhf\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.115486 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.115381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.115486 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.115418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.115486 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.115476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.216770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.216735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.216770 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.216771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.217034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.216800    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.217034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.216846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.217034 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.216863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqhf\" (UniqueName: \"kubernetes.io/projected/03be99aa-424c-4ced-8cc6-c21d58081fd9-kube-api-access-5hqhf\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.217279 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.217226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-manifests\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.219170 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.219143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03be99aa-424c-4ced-8cc6-c21d58081fd9-tmp\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.219441 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.219421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.219496 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.219474    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03be99aa-424c-4ced-8cc6-c21d58081fd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.224700 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.224676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqhf\" (UniqueName: \"kubernetes.io/projected/03be99aa-424c-4ced-8cc6-c21d58081fd9-kube-api-access-5hqhf\") pod \"opendatahub-operator-controller-manager-fdb769df8-wh2xw\" (UID: \"03be99aa-424c-4ced-8cc6-c21d58081fd9\") " pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.335002 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.334924    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:08.467535 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.467511    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"]
Jul 09 16:56:08.469776 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:56:08.469748    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03be99aa_424c_4ced_8cc6_c21d58081fd9.slice/crio-3452eaf6f7bb108de2687cecad4ffa4d368162ba32338fee2cdb2b3afdf2177d WatchSource:0}: Error finding container 3452eaf6f7bb108de2687cecad4ffa4d368162ba32338fee2cdb2b3afdf2177d: Status 404 returned error can't find the container with id 3452eaf6f7bb108de2687cecad4ffa4d368162ba32338fee2cdb2b3afdf2177d
Jul 09 16:56:08.653527 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:08.653487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw" event={"ID":"03be99aa-424c-4ced-8cc6-c21d58081fd9","Type":"ContainerStarted","Data":"3452eaf6f7bb108de2687cecad4ffa4d368162ba32338fee2cdb2b3afdf2177d"}
Jul 09 16:56:12.683134 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:12.683093    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw" event={"ID":"03be99aa-424c-4ced-8cc6-c21d58081fd9","Type":"ContainerStarted","Data":"5ab93126131e4c6d43e5b08c81ac676f9db2e825693fa7637f6b56c46a370ad2"}
Jul 09 16:56:13.689898 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:13.689859    2570 generic.go:356] "Generic (PLEG): container finished" podID="03be99aa-424c-4ced-8cc6-c21d58081fd9" containerID="5ab93126131e4c6d43e5b08c81ac676f9db2e825693fa7637f6b56c46a370ad2" exitCode=0
Jul 09 16:56:13.690278 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:13.689921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw" event={"ID":"03be99aa-424c-4ced-8cc6-c21d58081fd9","Type":"ContainerDied","Data":"5ab93126131e4c6d43e5b08c81ac676f9db2e825693fa7637f6b56c46a370ad2"}
Jul 09 16:56:14.696950 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:14.696911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw" event={"ID":"03be99aa-424c-4ced-8cc6-c21d58081fd9","Type":"ContainerStarted","Data":"09d5df443f6b45d00b14a6bb39ab6104b10f0c53b9cae02fe3b948a31764f85a"}
Jul 09 16:56:14.697331 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:14.697026    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:14.718870 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:14.718804    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw" podStartSLOduration=2.882441676 podStartE2EDuration="7.71878832s" totalImagesPullingTime="3.826734987s" totalInitContainerRuntime="1.009611657s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:14.716318253 +0000 UTC m=+334.049779417" watchObservedRunningTime="2026-07-09 16:56:14.71878832 +0000 UTC m=+334.052249433"
Jul 09 16:56:25.704503 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:25.704472    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fdb769df8-wh2xw"
Jul 09 16:56:28.422294 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.422255    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"]
Jul 09 16:56:28.430273 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.430247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.434516 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.434497    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 16:56:28.434613 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.434497    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 16:56:28.450703 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.450675    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"]
Jul 09 16:56:28.593203 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.593161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tmp\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.593388 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.593231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.593388 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.593318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdwd\" (UniqueName: \"kubernetes.io/projected/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-kube-api-access-4hdwd\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.694148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.694072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tmp\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.694148 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.694116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.694323 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:56:28.694207    2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 16:56:28.694323 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.694236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdwd\" (UniqueName: \"kubernetes.io/projected/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-kube-api-access-4hdwd\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.694323 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:56:28.694266    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs podName:7ea05c53-790d-45a5-83f9-8b4d52f0ba87 nodeName:}" failed. No retries permitted until 2026-07-09 16:56:29.194250601 +0000 UTC m=+348.527711696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs") pod "kube-auth-proxy-6b94bd4c99-6267q" (UID: "7ea05c53-790d-45a5-83f9-8b4d52f0ba87") : secret "kube-auth-proxy-tls" not found
Jul 09 16:56:28.696315 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.696294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tmp\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:28.711421 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:28.711400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdwd\" (UniqueName: \"kubernetes.io/projected/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-kube-api-access-4hdwd\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:29.199601 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.199572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:29.201981 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.201948    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ea05c53-790d-45a5-83f9-8b4d52f0ba87-tls-certs\") pod \"kube-auth-proxy-6b94bd4c99-6267q\" (UID: \"7ea05c53-790d-45a5-83f9-8b4d52f0ba87\") " pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:29.339325 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.339286    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"
Jul 09 16:56:29.482328 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.482302    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q"]
Jul 09 16:56:29.487326 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:56:29.487239    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea05c53_790d_45a5_83f9_8b4d52f0ba87.slice/crio-95ba08b2fee07ee4eb0847165e4d4e65bea27713eb78f46bdf2707363def0b92 WatchSource:0}: Error finding container 95ba08b2fee07ee4eb0847165e4d4e65bea27713eb78f46bdf2707363def0b92: Status 404 returned error can't find the container with id 95ba08b2fee07ee4eb0847165e4d4e65bea27713eb78f46bdf2707363def0b92
Jul 09 16:56:29.718799 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.718763    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kb7gr"]
Jul 09 16:56:29.723353 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.723332    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.726026 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.726004    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bgfx8\""
Jul 09 16:56:29.726168 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.726119    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 16:56:29.736508 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.736454    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kb7gr"]
Jul 09 16:56:29.764129 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.764091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q" event={"ID":"7ea05c53-790d-45a5-83f9-8b4d52f0ba87","Type":"ContainerStarted","Data":"95ba08b2fee07ee4eb0847165e4d4e65bea27713eb78f46bdf2707363def0b92"}
Jul 09 16:56:29.804129 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.804097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97hj8\" (UniqueName: \"kubernetes.io/projected/1ace2155-3702-47c7-b89f-9f9e7a642b8c-kube-api-access-97hj8\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.804306 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.804158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ace2155-3702-47c7-b89f-9f9e7a642b8c-tls-certs\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.904708 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.904678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97hj8\" (UniqueName: \"kubernetes.io/projected/1ace2155-3702-47c7-b89f-9f9e7a642b8c-kube-api-access-97hj8\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.904895 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.904741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ace2155-3702-47c7-b89f-9f9e7a642b8c-tls-certs\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.907306 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.907282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ace2155-3702-47c7-b89f-9f9e7a642b8c-tls-certs\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:29.915678 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:29.915648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97hj8\" (UniqueName: \"kubernetes.io/projected/1ace2155-3702-47c7-b89f-9f9e7a642b8c-kube-api-access-97hj8\") pod \"model-serving-api-54d89bd5fc-kb7gr\" (UID: \"1ace2155-3702-47c7-b89f-9f9e7a642b8c\") " pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:30.034215 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:30.034136    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:30.204146 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:30.204122    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kb7gr"]
Jul 09 16:56:30.206259 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:56:30.206228    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ace2155_3702_47c7_b89f_9f9e7a642b8c.slice/crio-2423baf84853b6ba756753a583ad4afab96003bb0dd1cf87e4137daf10e8cc00 WatchSource:0}: Error finding container 2423baf84853b6ba756753a583ad4afab96003bb0dd1cf87e4137daf10e8cc00: Status 404 returned error can't find the container with id 2423baf84853b6ba756753a583ad4afab96003bb0dd1cf87e4137daf10e8cc00
Jul 09 16:56:30.770980 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:30.770939    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr" event={"ID":"1ace2155-3702-47c7-b89f-9f9e7a642b8c","Type":"ContainerStarted","Data":"2423baf84853b6ba756753a583ad4afab96003bb0dd1cf87e4137daf10e8cc00"}
Jul 09 16:56:32.782286 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:32.782243    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q" event={"ID":"7ea05c53-790d-45a5-83f9-8b4d52f0ba87","Type":"ContainerStarted","Data":"58b3ebc51ece8c71767f5293c17f0fe1639e898b783006e8825eb955236f42a9"}
Jul 09 16:56:32.783736 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:32.783711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr" event={"ID":"1ace2155-3702-47c7-b89f-9f9e7a642b8c","Type":"ContainerStarted","Data":"ffb06f0b6d6a92ca25c19d14e4f41c7cadfb6ffc7846ce31ed3776794d9f01b6"}
Jul 09 16:56:32.783871 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:32.783776    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:32.804342 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:32.804295    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b94bd4c99-6267q" podStartSLOduration=2.142841486 podStartE2EDuration="4.80428064s" totalImagesPullingTime="2.661439154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:32.803091291 +0000 UTC m=+352.136552404" watchObservedRunningTime="2026-07-09 16:56:32.80428064 +0000 UTC m=+352.137741784"
Jul 09 16:56:32.822908 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:32.822820    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr" podStartSLOduration=1.881467991 podStartE2EDuration="3.822798142s" totalImagesPullingTime="1.941330151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:32.820376967 +0000 UTC m=+352.153838080" watchObservedRunningTime="2026-07-09 16:56:32.822798142 +0000 UTC m=+352.156259258"
Jul 09 16:56:36.192124 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.192050    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"]
Jul 09 16:56:36.195229 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.195209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.198198 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.198177    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 16:56:36.198319 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.198200    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4qkgw\""
Jul 09 16:56:36.210492 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.210470    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"]
Jul 09 16:56:36.361856 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.361793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362023 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.361870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7lv\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-kube-api-access-gj7lv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362023 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.361909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362023 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.361990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.362039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.362101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.362156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362345 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.362242    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.362345 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.362277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463368 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463368 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7lv\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-kube-api-access-gj7lv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463472    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.463954 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.464009 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.463968    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.464059 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.464050    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.464125 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.464097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.464329 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.464307    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.465803 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.465784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.465973 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.465955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.471583 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.471561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7lv\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-kube-api-access-gj7lv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.471964 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.471944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bd24181-3ca7-4e5e-89e7-52e750900ae2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44xsgk\" (UID: \"5bd24181-3ca7-4e5e-89e7-52e750900ae2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.505073 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.505043    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:36.711096 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:56:36.711035    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd24181_3ca7_4e5e_89e7_52e750900ae2.slice/crio-893ad5e3be664f6f8e40470199c02915e1ccd0aa5ae22bfc218ffb96920ee439 WatchSource:0}: Error finding container 893ad5e3be664f6f8e40470199c02915e1ccd0aa5ae22bfc218ffb96920ee439: Status 404 returned error can't find the container with id 893ad5e3be664f6f8e40470199c02915e1ccd0aa5ae22bfc218ffb96920ee439
Jul 09 16:56:36.714479 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.714446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"]
Jul 09 16:56:36.802012 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:36.801979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk" event={"ID":"5bd24181-3ca7-4e5e-89e7-52e750900ae2","Type":"ContainerStarted","Data":"893ad5e3be664f6f8e40470199c02915e1ccd0aa5ae22bfc218ffb96920ee439"}
Jul 09 16:56:38.696579 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.696548    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"]
Jul 09 16:56:38.703378 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.703355    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.706052 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.706024    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 16:56:38.706163 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.706144    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 16:56:38.706383 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.706359    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4fxxr\""
Jul 09 16:56:38.706490 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.706411    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 16:56:38.716377 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.716351    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"]
Jul 09 16:56:38.883189 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883359 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883359 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kwnb\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-kube-api-access-5kwnb\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883359 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883506 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883506 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.883506 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.883424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aebbefd-97a9-4aca-a7a0-dde059d933e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984073 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.983970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kwnb\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-kube-api-access-5kwnb\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984073 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aebbefd-97a9-4aca-a7a0-dde059d933e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.984334 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.984254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.985097 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.985059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.987189 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.987159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.987375 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.987228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4aebbefd-97a9-4aca-a7a0-dde059d933e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.987375 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.987295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.987555 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.987532    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.993898 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.993870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kwnb\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-kube-api-access-5kwnb\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:38.994031 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:38.993927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4aebbefd-97a9-4aca-a7a0-dde059d933e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bzg67\" (UID: \"4aebbefd-97a9-4aca-a7a0-dde059d933e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:39.015131 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.015104    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:39.479354 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.479304    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 16:56:39.479466 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.479407    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 16:56:39.479466 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.479457    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 16:56:39.551217 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.551194    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"]
Jul 09 16:56:39.552636 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:56:39.552611    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aebbefd_97a9_4aca_a7a0_dde059d933e2.slice/crio-64bc9678a73cd5c9bacd38fdfbaf3f76ebcdb3af11d72cb21e94770a7263b4a2 WatchSource:0}: Error finding container 64bc9678a73cd5c9bacd38fdfbaf3f76ebcdb3af11d72cb21e94770a7263b4a2: Status 404 returned error can't find the container with id 64bc9678a73cd5c9bacd38fdfbaf3f76ebcdb3af11d72cb21e94770a7263b4a2
Jul 09 16:56:39.824347 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.824261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67" event={"ID":"4aebbefd-97a9-4aca-a7a0-dde059d933e2","Type":"ContainerStarted","Data":"64bc9678a73cd5c9bacd38fdfbaf3f76ebcdb3af11d72cb21e94770a7263b4a2"}
Jul 09 16:56:39.825841 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.825805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk" event={"ID":"5bd24181-3ca7-4e5e-89e7-52e750900ae2","Type":"ContainerStarted","Data":"846e7cfacc5fa4c61c990acd26cded20620a168076dfb3760c729a7903068e13"}
Jul 09 16:56:39.866131 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:39.866079    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk" podStartSLOduration=1.100827569 podStartE2EDuration="3.86606169s" totalImagesPullingTime="2.765234121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:39.863797949 +0000 UTC m=+359.197259064" watchObservedRunningTime="2026-07-09 16:56:39.86606169 +0000 UTC m=+359.199522860"
Jul 09 16:56:40.506426 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:40.506348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:40.511932 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:40.511853    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:40.831183 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:40.831102    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:40.832206 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:40.832185    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44xsgk"
Jul 09 16:56:42.109011 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:42.108976    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 16:56:42.109255 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:42.109046    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 16:56:42.845339 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:42.845296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67" event={"ID":"4aebbefd-97a9-4aca-a7a0-dde059d933e2","Type":"ContainerStarted","Data":"d55457f2c95d09fb7ef4cabb22343b0d29e5d4438daed152a79936245d559c5c"}
Jul 09 16:56:42.870654 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:42.870608    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67" podStartSLOduration=2.317033325 podStartE2EDuration="4.870591216s" totalImagesPullingTime="2.553557891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:42.869432934 +0000 UTC m=+362.202894049" watchObservedRunningTime="2026-07-09 16:56:42.870591216 +0000 UTC m=+362.204052330"
Jul 09 16:56:43.792816 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:43.792784    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kb7gr"
Jul 09 16:56:43.850841 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:43.850794    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:56:43.852405 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:56:43.852383    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bzg67"
Jul 09 16:57:56.893172 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.893134    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"]
Jul 09 16:57:56.895549 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.895532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:56.898491 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.898471    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-47zsg\""
Jul 09 16:57:56.898858 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.898842    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 16:57:56.899618 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.899598    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 16:57:56.906487 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.906461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"]
Jul 09 16:57:56.921098 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.921066    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:56.921226 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.921101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:56.921226 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.921130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthbb\" (UniqueName: \"kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:56.987498 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.987461    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"]
Jul 09 16:57:56.990052 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.990034    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:56.999601 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:56.999577    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"]
Jul 09 16:57:57.022047 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.022199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.022199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022081    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56bz\" (UniqueName: \"kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.022271 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.022271 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.022338 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthbb\" (UniqueName: \"kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.022684 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022662    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.022684 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.022675    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.031360 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.031334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthbb\" (UniqueName: \"kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.123468 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.123434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.123617 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.123479    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.123617 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.123498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56bz\" (UniqueName: \"kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.123860 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.123814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.123860 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.123824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.132312 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.132283    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56bz\" (UniqueName: \"kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.205007 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.204930    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:57:57.298897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.298860    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"]
Jul 09 16:57:57.299634 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.299605    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:57:57.302037 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.302016    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.310533 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.310460    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"]
Jul 09 16:57:57.325109 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.325077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tss57\" (UniqueName: \"kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.325211 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.325135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.325271 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.325255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.346079 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.346054    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"]
Jul 09 16:57:57.348442 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:57:57.348417    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2b7a3e_4469_4f3a_8e62_7eb37fcef037.slice/crio-fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850 WatchSource:0}: Error finding container fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850: Status 404 returned error can't find the container with id fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850
Jul 09 16:57:57.425990 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.425958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.426111 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.426030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tss57\" (UniqueName: \"kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.426111 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.426067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.426396 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.426371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.426459 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.426432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.436021 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.435997    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tss57\" (UniqueName: \"kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.445376 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.445350    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"]
Jul 09 16:57:57.445659 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:57:57.445637    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954a8a99_cc4a_40d2_a8b2_1dd2a0cd96cd.slice/crio-184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065 WatchSource:0}: Error finding container 184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065: Status 404 returned error can't find the container with id 184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065
Jul 09 16:57:57.628821 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.628786    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:57:57.696315 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.696274    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"]
Jul 09 16:57:57.698968 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.698950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.708406 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.708346    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"]
Jul 09 16:57:57.728499 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.728474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.728642 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.728505    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrkd\" (UniqueName: \"kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.728642 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.728525    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.762310 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.762238    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"]
Jul 09 16:57:57.764512 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:57:57.764487    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8312d9e_b010_4f63_b579_aae04e2b886f.slice/crio-88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2 WatchSource:0}: Error finding container 88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2: Status 404 returned error can't find the container with id 88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2
Jul 09 16:57:57.829778 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.829753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.829941 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.829788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrkd\" (UniqueName: \"kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.829941 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.829807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.830123 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.830104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.830156 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.830124    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:57.842622 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:57.842593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrkd\" (UniqueName: \"kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:58.008898 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.008785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:57:58.138706 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.138681    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"]
Jul 09 16:57:58.140132 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:57:58.140110    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f897493_60db_45b1_a28e_a0a8e6884881.slice/crio-275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9 WatchSource:0}: Error finding container 275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9: Status 404 returned error can't find the container with id 275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9
Jul 09 16:57:58.196867 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.196820    2570 generic.go:356] "Generic (PLEG): container finished" podID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerID="49875b7684f0f9b25a52ff5f52f1cd72d70b39e6bec5629e430938807b0a5a3b" exitCode=0
Jul 09 16:57:58.196965 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.196869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl" event={"ID":"e8312d9e-b010-4f63-b579-aae04e2b886f","Type":"ContainerDied","Data":"49875b7684f0f9b25a52ff5f52f1cd72d70b39e6bec5629e430938807b0a5a3b"}
Jul 09 16:57:58.196965 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.196911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl" event={"ID":"e8312d9e-b010-4f63-b579-aae04e2b886f","Type":"ContainerStarted","Data":"88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2"}
Jul 09 16:57:58.198530 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.198510    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerID="d2d6536ff44edbcef922eb15e15f80bed2014b18f740acdede9694c995499bc2" exitCode=0
Jul 09 16:57:58.198629 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.198591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth" event={"ID":"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037","Type":"ContainerDied","Data":"d2d6536ff44edbcef922eb15e15f80bed2014b18f740acdede9694c995499bc2"}
Jul 09 16:57:58.198629 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.198627    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth" event={"ID":"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037","Type":"ContainerStarted","Data":"fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850"}
Jul 09 16:57:58.200566 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.200464    2570 generic.go:356] "Generic (PLEG): container finished" podID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerID="aa7dae0894a21049cbe68784fc59fc5563db0a765386246a1fcc542358ba8a0c" exitCode=0
Jul 09 16:57:58.200566 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.200494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw" event={"ID":"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd","Type":"ContainerDied","Data":"aa7dae0894a21049cbe68784fc59fc5563db0a765386246a1fcc542358ba8a0c"}
Jul 09 16:57:58.200566 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.200536    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw" event={"ID":"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd","Type":"ContainerStarted","Data":"184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065"}
Jul 09 16:57:58.202019 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:58.201999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql" event={"ID":"3f897493-60db-45b1-a28e-a0a8e6884881","Type":"ContainerStarted","Data":"275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9"}
Jul 09 16:57:59.208124 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.208086    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f897493-60db-45b1-a28e-a0a8e6884881" containerID="8401d5e36febd22c2861e8931c333feae46c914f9abb18955fca192a70d6c714" exitCode=0
Jul 09 16:57:59.208545 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.208164    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql" event={"ID":"3f897493-60db-45b1-a28e-a0a8e6884881","Type":"ContainerDied","Data":"8401d5e36febd22c2861e8931c333feae46c914f9abb18955fca192a70d6c714"}
Jul 09 16:57:59.210199 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.210179    2570 generic.go:356] "Generic (PLEG): container finished" podID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerID="4e3cfaa2bc5054ad4ffce2875c7b6b8030c8a15ea5a0329ee31022a619ec4127" exitCode=0
Jul 09 16:57:59.210294 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.210244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl" event={"ID":"e8312d9e-b010-4f63-b579-aae04e2b886f","Type":"ContainerDied","Data":"4e3cfaa2bc5054ad4ffce2875c7b6b8030c8a15ea5a0329ee31022a619ec4127"}
Jul 09 16:57:59.212258 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.212236    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerID="6647159c2803c3dfa3a422b2479d1f43f68ddc548785625f692789323e92e117" exitCode=0
Jul 09 16:57:59.212355 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.212313    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth" event={"ID":"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037","Type":"ContainerDied","Data":"6647159c2803c3dfa3a422b2479d1f43f68ddc548785625f692789323e92e117"}
Jul 09 16:57:59.214371 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.214349    2570 generic.go:356] "Generic (PLEG): container finished" podID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerID="1f1040fc36abd1b79c67c6f982bb816e38f87ea27560ce93c1e73b66b3ae5828" exitCode=0
Jul 09 16:57:59.214446 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:57:59.214377    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw" event={"ID":"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd","Type":"ContainerDied","Data":"1f1040fc36abd1b79c67c6f982bb816e38f87ea27560ce93c1e73b66b3ae5828"}
Jul 09 16:58:00.221968 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.221927    2570 generic.go:356] "Generic (PLEG): container finished" podID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerID="c8c6d8e0aefbe0508ff60c194064718b10457ff4a50166094eddeb94d950f87d" exitCode=0
Jul 09 16:58:00.222357 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.221988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw" event={"ID":"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd","Type":"ContainerDied","Data":"c8c6d8e0aefbe0508ff60c194064718b10457ff4a50166094eddeb94d950f87d"}
Jul 09 16:58:00.223790 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.223766    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f897493-60db-45b1-a28e-a0a8e6884881" containerID="c2e1c1a0e87b5f3e4b632cb61e195172d8f6db43759228a8c10d7df5c49a0b1e" exitCode=0
Jul 09 16:58:00.223941 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.223918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql" event={"ID":"3f897493-60db-45b1-a28e-a0a8e6884881","Type":"ContainerDied","Data":"c2e1c1a0e87b5f3e4b632cb61e195172d8f6db43759228a8c10d7df5c49a0b1e"}
Jul 09 16:58:00.226272 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.226242    2570 generic.go:356] "Generic (PLEG): container finished" podID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerID="6f744cc77bb2629df23188ff5b8863cdb114ec5391ebf31ca5bcc252d111728c" exitCode=0
Jul 09 16:58:00.226380 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.226311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl" event={"ID":"e8312d9e-b010-4f63-b579-aae04e2b886f","Type":"ContainerDied","Data":"6f744cc77bb2629df23188ff5b8863cdb114ec5391ebf31ca5bcc252d111728c"}
Jul 09 16:58:00.228397 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.228371    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerID="5e4f94fa4af495525acba0624d04e076669a26805f423f19c5c2b01efb289efe" exitCode=0
Jul 09 16:58:00.228484 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:00.228396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth" event={"ID":"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037","Type":"ContainerDied","Data":"5e4f94fa4af495525acba0624d04e076669a26805f423f19c5c2b01efb289efe"}
Jul 09 16:58:01.234765 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.234727    2570 generic.go:356] "Generic (PLEG): container finished" podID="3f897493-60db-45b1-a28e-a0a8e6884881" containerID="aea2db7e492459cc6e12fe706cbb1a32e08b10fcb5e66196ab305cc4ef29f31d" exitCode=0
Jul 09 16:58:01.235282 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.234807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql" event={"ID":"3f897493-60db-45b1-a28e-a0a8e6884881","Type":"ContainerDied","Data":"aea2db7e492459cc6e12fe706cbb1a32e08b10fcb5e66196ab305cc4ef29f31d"}
Jul 09 16:58:01.387126 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.387101    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:58:01.422206 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.422179    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:58:01.425119 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.425096    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:58:01.459880 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.459826    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zthbb\" (UniqueName: \"kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb\") pod \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") "
Jul 09 16:58:01.460056 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.459927    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle\") pod \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") "
Jul 09 16:58:01.460056 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.459966    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util\") pod \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\" (UID: \"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037\") "
Jul 09 16:58:01.460056 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.459997    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle\") pod \"e8312d9e-b010-4f63-b579-aae04e2b886f\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") "
Jul 09 16:58:01.460056 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.460029    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util\") pod \"e8312d9e-b010-4f63-b579-aae04e2b886f\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") "
Jul 09 16:58:01.460270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.460071    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle\") pod \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") "
Jul 09 16:58:01.460270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.460109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util\") pod \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") "
Jul 09 16:58:01.460270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.460135    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tss57\" (UniqueName: \"kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57\") pod \"e8312d9e-b010-4f63-b579-aae04e2b886f\" (UID: \"e8312d9e-b010-4f63-b579-aae04e2b886f\") "
Jul 09 16:58:01.460270 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.460175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56bz\" (UniqueName: \"kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz\") pod \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\" (UID: \"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd\") "
Jul 09 16:58:01.461298 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.461186    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle" (OuterVolumeSpecName: "bundle") pod "e8312d9e-b010-4f63-b579-aae04e2b886f" (UID: "e8312d9e-b010-4f63-b579-aae04e2b886f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.463269 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.461530    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle" (OuterVolumeSpecName: "bundle") pod "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" (UID: "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.463269 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.463213    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle" (OuterVolumeSpecName: "bundle") pod "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" (UID: "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.463423 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.463297    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz" (OuterVolumeSpecName: "kube-api-access-t56bz") pod "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" (UID: "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd"). InnerVolumeSpecName "kube-api-access-t56bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:01.463684 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.463647    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57" (OuterVolumeSpecName: "kube-api-access-tss57") pod "e8312d9e-b010-4f63-b579-aae04e2b886f" (UID: "e8312d9e-b010-4f63-b579-aae04e2b886f"). InnerVolumeSpecName "kube-api-access-tss57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:01.464685 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.464657    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb" (OuterVolumeSpecName: "kube-api-access-zthbb") pod "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" (UID: "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037"). InnerVolumeSpecName "kube-api-access-zthbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:01.468464 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.468435    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util" (OuterVolumeSpecName: "util") pod "e8312d9e-b010-4f63-b579-aae04e2b886f" (UID: "e8312d9e-b010-4f63-b579-aae04e2b886f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.471325 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.471300    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util" (OuterVolumeSpecName: "util") pod "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" (UID: "3f2b7a3e-4469-4f3a-8e62-7eb37fcef037"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.472214 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.472195    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util" (OuterVolumeSpecName: "util") pod "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" (UID: "954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561000    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561029    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8312d9e-b010-4f63-b579-aae04e2b886f-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561040    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561047    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561056    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tss57\" (UniqueName: \"kubernetes.io/projected/e8312d9e-b010-4f63-b579-aae04e2b886f-kube-api-access-tss57\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561067    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t56bz\" (UniqueName: \"kubernetes.io/projected/954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd-kube-api-access-t56bz\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561076    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zthbb\" (UniqueName: \"kubernetes.io/projected/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-kube-api-access-zthbb\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561084    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:01.561088 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:01.561093    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f2b7a3e-4469-4f3a-8e62-7eb37fcef037-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:02.241727 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.241699    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw"
Jul 09 16:58:02.242184 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.241732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw" event={"ID":"954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd","Type":"ContainerDied","Data":"184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065"}
Jul 09 16:58:02.242184 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.241776    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="184b8884e726838df32f9151d9eec68c2667cc2945899f270fe31cce1f642065"
Jul 09 16:58:02.243589 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.243570    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl"
Jul 09 16:58:02.243705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.243586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl" event={"ID":"e8312d9e-b010-4f63-b579-aae04e2b886f","Type":"ContainerDied","Data":"88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2"}
Jul 09 16:58:02.243705 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.243626    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88d508abbb192849ec8a0d4dd10efeb0805bac7bc078b6e41292a38bbd81bdb2"
Jul 09 16:58:02.245475 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.245457    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth"
Jul 09 16:58:02.245475 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.245460    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth" event={"ID":"3f2b7a3e-4469-4f3a-8e62-7eb37fcef037","Type":"ContainerDied","Data":"fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850"}
Jul 09 16:58:02.245632 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.245501    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb635b1cc2903d3ea5bf8fd97ea02773d419530adf9f5d41b72aa07ca5ae4850"
Jul 09 16:58:02.362941 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.362913    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:58:02.467226 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.467195    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle\") pod \"3f897493-60db-45b1-a28e-a0a8e6884881\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") "
Jul 09 16:58:02.467433 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.467260    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcrkd\" (UniqueName: \"kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd\") pod \"3f897493-60db-45b1-a28e-a0a8e6884881\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") "
Jul 09 16:58:02.467433 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.467321    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util\") pod \"3f897493-60db-45b1-a28e-a0a8e6884881\" (UID: \"3f897493-60db-45b1-a28e-a0a8e6884881\") "
Jul 09 16:58:02.467771 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.467745    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle" (OuterVolumeSpecName: "bundle") pod "3f897493-60db-45b1-a28e-a0a8e6884881" (UID: "3f897493-60db-45b1-a28e-a0a8e6884881"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:02.469415 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.469388    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd" (OuterVolumeSpecName: "kube-api-access-bcrkd") pod "3f897493-60db-45b1-a28e-a0a8e6884881" (UID: "3f897493-60db-45b1-a28e-a0a8e6884881"). InnerVolumeSpecName "kube-api-access-bcrkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 16:58:02.472875 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.472852    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util" (OuterVolumeSpecName: "util") pod "3f897493-60db-45b1-a28e-a0a8e6884881" (UID: "3f897493-60db-45b1-a28e-a0a8e6884881"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 16:58:02.568106 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.568014    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-util\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:02.568106 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.568045    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f897493-60db-45b1-a28e-a0a8e6884881-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:02.568106 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:02.568059    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcrkd\" (UniqueName: \"kubernetes.io/projected/3f897493-60db-45b1-a28e-a0a8e6884881-kube-api-access-bcrkd\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 16:58:03.252697 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:03.252661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql" event={"ID":"3f897493-60db-45b1-a28e-a0a8e6884881","Type":"ContainerDied","Data":"275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9"}
Jul 09 16:58:03.253062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:03.252711    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="275e367ad387e89f9e4f8572246832719b255674836a2c3fa40d252ff09c51c9"
Jul 09 16:58:03.253062 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:03.252742    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql"
Jul 09 16:58:12.167274 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167236    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"]
Jul 09 16:58:12.167748 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167729    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="pull"
Jul 09 16:58:12.167812 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167751    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="pull"
Jul 09 16:58:12.167812 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167767    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="pull"
Jul 09 16:58:12.167812 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167775    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="pull"
Jul 09 16:58:12.167812 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167794    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="pull"
Jul 09 16:58:12.167812 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167804    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="pull"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167819    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167844    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167860    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167869    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167879    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="pull"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167888    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="pull"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167904    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167919    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167927    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167937    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167945    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167957    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167966    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="util"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167974    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167982    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.167993    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="extract"
Jul 09 16:58:12.168042 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.168002    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="extract"
Jul 09 16:58:12.168531 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.168086    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8312d9e-b010-4f63-b579-aae04e2b886f" containerName="extract"
Jul 09 16:58:12.168531 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.168100    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f897493-60db-45b1-a28e-a0a8e6884881" containerName="extract"
Jul 09 16:58:12.168531 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.168111    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f2b7a3e-4469-4f3a-8e62-7eb37fcef037" containerName="extract"
Jul 09 16:58:12.168531 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.168121    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd" containerName="extract"
Jul 09 16:58:12.171469 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.171451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:12.174602 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.174580    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 16:58:12.174718 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.174648    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ctcxm\""
Jul 09 16:58:12.176045 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.176027    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 16:58:12.199513 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.199485    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"]
Jul 09 16:58:12.257071 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.257028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzng\" (UniqueName: \"kubernetes.io/projected/7287f5e2-ecca-4582-ab7e-61ac8a8d44b9-kube-api-access-lqzng\") pod \"authorino-operator-75cc8d5cb7-j27rz\" (UID: \"7287f5e2-ecca-4582-ab7e-61ac8a8d44b9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:12.358387 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.358353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzng\" (UniqueName: \"kubernetes.io/projected/7287f5e2-ecca-4582-ab7e-61ac8a8d44b9-kube-api-access-lqzng\") pod \"authorino-operator-75cc8d5cb7-j27rz\" (UID: \"7287f5e2-ecca-4582-ab7e-61ac8a8d44b9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:12.369870 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.369815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzng\" (UniqueName: \"kubernetes.io/projected/7287f5e2-ecca-4582-ab7e-61ac8a8d44b9-kube-api-access-lqzng\") pod \"authorino-operator-75cc8d5cb7-j27rz\" (UID: \"7287f5e2-ecca-4582-ab7e-61ac8a8d44b9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:12.482272 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.482191    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:12.612810 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:12.612783    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"]
Jul 09 16:58:12.614932 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:58:12.614901    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7287f5e2_ecca_4582_ab7e_61ac8a8d44b9.slice/crio-4cb6f5ea34246d5e038bee1f4fe4ef3eeecdeae3684122e8165ce6c42cc4ee2b WatchSource:0}: Error finding container 4cb6f5ea34246d5e038bee1f4fe4ef3eeecdeae3684122e8165ce6c42cc4ee2b: Status 404 returned error can't find the container with id 4cb6f5ea34246d5e038bee1f4fe4ef3eeecdeae3684122e8165ce6c42cc4ee2b
Jul 09 16:58:13.305592 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:13.305554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz" event={"ID":"7287f5e2-ecca-4582-ab7e-61ac8a8d44b9","Type":"ContainerStarted","Data":"4cb6f5ea34246d5e038bee1f4fe4ef3eeecdeae3684122e8165ce6c42cc4ee2b"}
Jul 09 16:58:15.318537 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:15.318445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz" event={"ID":"7287f5e2-ecca-4582-ab7e-61ac8a8d44b9","Type":"ContainerStarted","Data":"239da6e5c6c52b7deb518455c6bb1a96c55e456bc081578930ec57b1e948cc64"}
Jul 09 16:58:15.318920 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:15.318580    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:15.340219 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:15.340174    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz" podStartSLOduration=1.018774425 podStartE2EDuration="3.340159847s" totalImagesPullingTime="2.321385422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:15.33938634 +0000 UTC m=+454.672847454" watchObservedRunningTime="2026-07-09 16:58:15.340159847 +0000 UTC m=+454.673620961"
Jul 09 16:58:26.326896 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:26.326854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j27rz"
Jul 09 16:58:28.929090 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.929057    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"]
Jul 09 16:58:28.932477 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.932459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:28.936670 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.936651    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7fkt\""
Jul 09 16:58:28.955365 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.955342    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"]
Jul 09 16:58:28.975015 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.974985    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"]
Jul 09 16:58:28.975257 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:58:28.975238    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-fhfzw], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-fhfzw]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78"
Jul 09 16:58:28.984897 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:28.984872    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"]
Jul 09 16:58:29.030544 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.030514    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 16:58:29.033956 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.033939    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.055443 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.055420    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 16:58:29.190032 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.189948    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78" path="/var/lib/kubelet/pods/469a6c28-fdbf-40ad-88e6-e4c6ba60ec78/volumes"
Jul 09 16:58:29.207329 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.207302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.207483 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.207336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ckf4\" (UniqueName: \"kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.307951 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.307920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.307951 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.307958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ckf4\" (UniqueName: \"kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.308294 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.308272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.317415 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.317383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ckf4\" (UniqueName: \"kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cbmgb\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.343379 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.343345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:29.388542 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.388512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:29.396654 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.396620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:29.399380 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:58:29.399339    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-g5rgl\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:29.484000 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:29.483969    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 16:58:29.486800 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:58:29.486771    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706ae3df_e38e_45de_bc16_8dc7dce7d358.slice/crio-4a387ac344786fb53bcf2ea4f7f4e55817188029cb1da8c220d4f69af28e89e2 WatchSource:0}: Error finding container 4a387ac344786fb53bcf2ea4f7f4e55817188029cb1da8c220d4f69af28e89e2: Status 404 returned error can't find the container with id 4a387ac344786fb53bcf2ea4f7f4e55817188029cb1da8c220d4f69af28e89e2
Jul 09 16:58:30.396476 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:30.396449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:30.396476 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:30.396443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" event={"ID":"706ae3df-e38e-45de-bc16-8dc7dce7d358","Type":"ContainerStarted","Data":"4a387ac344786fb53bcf2ea4f7f4e55817188029cb1da8c220d4f69af28e89e2"}
Jul 09 16:58:30.399111 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:58:30.399069    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-g5rgl\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:30.406405 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:58:30.406364    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-g5rgl\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:31.190908 ip-10-0-135-121 kubenswrapper[2570]: E0709 16:58:31.190870    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-g5rgl\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="469a6c28-fdbf-40ad-88e6-e4c6ba60ec78" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g5rgl"
Jul 09 16:58:34.422141 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:34.422102    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" event={"ID":"706ae3df-e38e-45de-bc16-8dc7dce7d358","Type":"ContainerStarted","Data":"b9075c3aae8338c37e681182f7606cec2c7617b942e5d785882828a42f97684f"}
Jul 09 16:58:34.422573 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:34.422210    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:58:34.446741 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:34.446690    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" podStartSLOduration=2.001454894 podStartE2EDuration="6.446673607s" totalImagesPullingTime="4.445218713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:34.444955339 +0000 UTC m=+473.778416472" watchObservedRunningTime="2026-07-09 16:58:34.446673607 +0000 UTC m=+473.780134721"
Jul 09 16:58:45.429586 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:58:45.429548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 16:59:06.694097 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.694062    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 16:59:06.696425 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.696404    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.698894 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.698872    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-47zsg\""
Jul 09 16:59:06.699048 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.698872    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 16:59:06.705354 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.705313    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 16:59:06.731236 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.731203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 16:59:06.816338 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.816300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh2v4\" (UniqueName: \"kubernetes.io/projected/eb29f4a2-9ef2-487a-886a-5999845357d6-kube-api-access-fh2v4\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.816538 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.816352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb29f4a2-9ef2-487a-886a-5999845357d6-config-file\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.917496 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.917459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2v4\" (UniqueName: \"kubernetes.io/projected/eb29f4a2-9ef2-487a-886a-5999845357d6-kube-api-access-fh2v4\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.917658 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.917505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb29f4a2-9ef2-487a-886a-5999845357d6-config-file\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.918121 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.918102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eb29f4a2-9ef2-487a-886a-5999845357d6-config-file\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:06.926124 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:06.926101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh2v4\" (UniqueName: \"kubernetes.io/projected/eb29f4a2-9ef2-487a-886a-5999845357d6-kube-api-access-fh2v4\") pod \"limitador-limitador-54d6d988d5-fkp2t\" (UID: \"eb29f4a2-9ef2-487a-886a-5999845357d6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:07.008029 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:07.007955    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:07.135916 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:07.135889    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 16:59:07.137464 ip-10-0-135-121 kubenswrapper[2570]: W0709 16:59:07.137432    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb29f4a2_9ef2_487a_886a_5999845357d6.slice/crio-1ee97a0354cb6e2258faac9783595e348db70f31c189e2ae2f090a949b0e75c4 WatchSource:0}: Error finding container 1ee97a0354cb6e2258faac9783595e348db70f31c189e2ae2f090a949b0e75c4: Status 404 returned error can't find the container with id 1ee97a0354cb6e2258faac9783595e348db70f31c189e2ae2f090a949b0e75c4
Jul 09 16:59:07.594230 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:07.594150    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t" event={"ID":"eb29f4a2-9ef2-487a-886a-5999845357d6","Type":"ContainerStarted","Data":"1ee97a0354cb6e2258faac9783595e348db70f31c189e2ae2f090a949b0e75c4"}
Jul 09 16:59:09.606299 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:09.606261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t" event={"ID":"eb29f4a2-9ef2-487a-886a-5999845357d6","Type":"ContainerStarted","Data":"922818046c3eb9d170f74e5b3c528bf73f667773fcba6bd57affd083170de091"}
Jul 09 16:59:09.606673 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:09.606371    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 16:59:09.623551 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:09.623507    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t" podStartSLOduration=1.271690937 podStartE2EDuration="3.623482968s" totalImagesPullingTime="2.351792031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:09.621211489 +0000 UTC m=+508.954672622" watchObservedRunningTime="2026-07-09 16:59:09.623482968 +0000 UTC m=+508.956944081"
Jul 09 16:59:20.612137 ip-10-0-135-121 kubenswrapper[2570]: I0709 16:59:20.612107    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"
Jul 09 17:00:18.059154 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:18.059119    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:00:41.073861 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:41.073809    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:00:41.075290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:41.075259    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:00:41.078109 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:41.078087    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:00:41.079639 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:41.079615    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:00:41.456180 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:41.456144    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:00:50.759632 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:00:50.759592    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:01:04.443551 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:04.443461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:01:33.912842 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.912791    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"]
Jul 09 17:01:33.916369 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.916351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.920458 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.920434    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 17:01:33.920590 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.920477    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ccqbg\""
Jul 09 17:01:33.920590 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.920482    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 17:01:33.920590 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.920513    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 17:01:33.925744 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.925721    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"]
Jul 09 17:01:33.992761 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.992727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.992957 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.992777    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/538df19d-ee4a-43f1-b372-53c904be734d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.992957 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.992857    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.992957 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.992908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdq2\" (UniqueName: \"kubernetes.io/projected/538df19d-ee4a-43f1-b372-53c904be734d-kube-api-access-6rdq2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.993117 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.992966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:33.993117 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:33.993007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.094362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.094323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdq2\" (UniqueName: \"kubernetes.io/projected/538df19d-ee4a-43f1-b372-53c904be734d-kube-api-access-6rdq2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.094606 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.094589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.094739 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.094723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.094955 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.094937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.095084 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.095071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/538df19d-ee4a-43f1-b372-53c904be734d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.095189 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.095176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.096205 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.096183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.096567 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.096543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.096956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.096931    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.100064 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.100045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/538df19d-ee4a-43f1-b372-53c904be734d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.104430 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.104409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdq2\" (UniqueName: \"kubernetes.io/projected/538df19d-ee4a-43f1-b372-53c904be734d-kube-api-access-6rdq2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.105542 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.105518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/538df19d-ee4a-43f1-b372-53c904be734d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs\" (UID: \"538df19d-ee4a-43f1-b372-53c904be734d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.227417 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.227324    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:34.363912 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.363885    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"]
Jul 09 17:01:34.365947 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:01:34.365915    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538df19d_ee4a_43f1_b372_53c904be734d.slice/crio-e99dbb0344a129a729bf6aa8f4fbb48c97706d84b5343a052f63e2bbb68b971e WatchSource:0}: Error finding container e99dbb0344a129a729bf6aa8f4fbb48c97706d84b5343a052f63e2bbb68b971e: Status 404 returned error can't find the container with id e99dbb0344a129a729bf6aa8f4fbb48c97706d84b5343a052f63e2bbb68b971e
Jul 09 17:01:34.367519 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:34.367502    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:01:35.361085 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:35.361047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs" event={"ID":"538df19d-ee4a-43f1-b372-53c904be734d","Type":"ContainerStarted","Data":"e99dbb0344a129a729bf6aa8f4fbb48c97706d84b5343a052f63e2bbb68b971e"}
Jul 09 17:01:35.647528 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:35.647477    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:01:36.368441 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:36.368347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs" event={"ID":"538df19d-ee4a-43f1-b372-53c904be734d","Type":"ContainerStarted","Data":"8a009af35581fbc63a01d654c34a4eabfd94f4f6457045503bfc17bd14064e62"}
Jul 09 17:01:36.386759 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:36.386713    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs" podStartSLOduration=1.765165141 podStartE2EDuration="3.386696288s" totalImagesPullingTime="1.621531147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:01:36.384501372 +0000 UTC m=+655.717962513" watchObservedRunningTime="2026-07-09 17:01:36.386696288 +0000 UTC m=+655.720157401"
Jul 09 17:01:44.228333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:44.228299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:44.228824 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:44.228387    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:44.240861 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:44.240821    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:44.418516 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:44.418490    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs"
Jul 09 17:01:44.747737 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:44.747701    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:01:53.558544 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:01:53.558502    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:03:06.053262 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:03:06.053225    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:03:15.547449 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:03:15.547412    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:03:27.053892 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:03:27.053855    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:03:34.985349 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:03:34.985308    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:03:45.654044 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:03:45.654003    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:04:12.649730 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:04:12.649648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:04:26.444945 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:04:26.444905    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:00.051402 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:00.051362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:09.352223 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:09.352189    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:19.851417 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:19.851378    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:28.151560 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:28.151523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:39.250689 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:39.250657    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:05:41.107272 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:41.107241    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:05:41.109874 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:41.109847    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:05:41.112650 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:41.112627    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:05:41.119349 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:41.119330    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:05:48.854224 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:05:48.854186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:06:00.244852 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:06:00.244801    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:06:10.144559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:06:10.144510    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:06:32.542753 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:06:32.542720    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:06:43.953084 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:06:43.953054    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:07:07.951881 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:07:07.951785    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:07:18.746359 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:07:18.746324    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:07:32.347648 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:07:32.347609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:07:44.150483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:07:44.150447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:07:53.646243 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:07:53.646203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:08:02.947485 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:02.947447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:08:12.451557 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:12.451522    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:08:37.402588 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:37.402549    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 17:08:37.403061 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:37.402760    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" podUID="706ae3df-e38e-45de-bc16-8dc7dce7d358" containerName="manager" containerID="cri-o://b9075c3aae8338c37e681182f7606cec2c7617b942e5d785882828a42f97684f" gracePeriod=10
Jul 09 17:08:40.760125 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.760099    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 17:08:40.854942 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.854860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ckf4\" (UniqueName: \"kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4\") pod \"706ae3df-e38e-45de-bc16-8dc7dce7d358\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") "
Jul 09 17:08:40.854942 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.854905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume\") pod \"706ae3df-e38e-45de-bc16-8dc7dce7d358\" (UID: \"706ae3df-e38e-45de-bc16-8dc7dce7d358\") "
Jul 09 17:08:40.855273 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.855246    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "706ae3df-e38e-45de-bc16-8dc7dce7d358" (UID: "706ae3df-e38e-45de-bc16-8dc7dce7d358"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:08:40.856856 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.856814    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4" (OuterVolumeSpecName: "kube-api-access-5ckf4") pod "706ae3df-e38e-45de-bc16-8dc7dce7d358" (UID: "706ae3df-e38e-45de-bc16-8dc7dce7d358"). InnerVolumeSpecName "kube-api-access-5ckf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:08:40.955576 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.955541    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ckf4\" (UniqueName: \"kubernetes.io/projected/706ae3df-e38e-45de-bc16-8dc7dce7d358-kube-api-access-5ckf4\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:08:40.955576 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:40.955571    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/706ae3df-e38e-45de-bc16-8dc7dce7d358-extensions-socket-volume\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:08:41.167780 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.167750    2570 scope.go:117] "RemoveContainer" containerID="b9075c3aae8338c37e681182f7606cec2c7617b942e5d785882828a42f97684f"
Jul 09 17:08:41.554614 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.554519    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"
Jul 09 17:08:41.554614 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.554554    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" event={"ID":"706ae3df-e38e-45de-bc16-8dc7dce7d358","Type":"ContainerDied","Data":"b9075c3aae8338c37e681182f7606cec2c7617b942e5d785882828a42f97684f"}
Jul 09 17:08:41.554614 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.554614    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb" event={"ID":"706ae3df-e38e-45de-bc16-8dc7dce7d358","Type":"ContainerDied","Data":"4a387ac344786fb53bcf2ea4f7f4e55817188029cb1da8c220d4f69af28e89e2"}
Jul 09 17:08:41.584912 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.584880    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 17:08:41.588547 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:41.588522    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cbmgb"]
Jul 09 17:08:43.188708 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:08:43.188663    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706ae3df-e38e-45de-bc16-8dc7dce7d358" path="/var/lib/kubelet/pods/706ae3df-e38e-45de-bc16-8dc7dce7d358/volumes"
Jul 09 17:09:38.530502 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.530464    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"]
Jul 09 17:09:38.531000 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.530815    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706ae3df-e38e-45de-bc16-8dc7dce7d358" containerName="manager"
Jul 09 17:09:38.531000 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.530825    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="706ae3df-e38e-45de-bc16-8dc7dce7d358" containerName="manager"
Jul 09 17:09:38.531000 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.530897    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="706ae3df-e38e-45de-bc16-8dc7dce7d358" containerName="manager"
Jul 09 17:09:38.533877 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.533861    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.536369 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.536350    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n7fkt\""
Jul 09 17:09:38.546428 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.546405    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"]
Jul 09 17:09:38.636854 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.636805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6028569a-c36d-4536-8698-fef395307412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.636854 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.636859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn7n4\" (UniqueName: \"kubernetes.io/projected/6028569a-c36d-4536-8698-fef395307412-kube-api-access-wn7n4\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.737363 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.737327    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6028569a-c36d-4536-8698-fef395307412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.737363 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.737366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn7n4\" (UniqueName: \"kubernetes.io/projected/6028569a-c36d-4536-8698-fef395307412-kube-api-access-wn7n4\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.737691 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.737672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6028569a-c36d-4536-8698-fef395307412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.759186 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.759159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn7n4\" (UniqueName: \"kubernetes.io/projected/6028569a-c36d-4536-8698-fef395307412-kube-api-access-wn7n4\") pod \"kuadrant-operator-controller-manager-86878c769f-qkptc\" (UID: \"6028569a-c36d-4536-8698-fef395307412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.844485 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.844383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:38.989617 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:38.989590    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"]
Jul 09 17:09:38.991328 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:09:38.991300    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6028569a_c36d_4536_8698_fef395307412.slice/crio-b5e7b79c326d5e195201c223075ae83b3b2a33ed565dd57f2da325b01d97c72e WatchSource:0}: Error finding container b5e7b79c326d5e195201c223075ae83b3b2a33ed565dd57f2da325b01d97c72e: Status 404 returned error can't find the container with id b5e7b79c326d5e195201c223075ae83b3b2a33ed565dd57f2da325b01d97c72e
Jul 09 17:09:39.861178 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:39.861143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc" event={"ID":"6028569a-c36d-4536-8698-fef395307412","Type":"ContainerStarted","Data":"28b4f5783edc74b039290f21fb42ea7b0a8942203c389a97ead67a23ff322dd8"}
Jul 09 17:09:39.861556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:39.861200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc" event={"ID":"6028569a-c36d-4536-8698-fef395307412","Type":"ContainerStarted","Data":"b5e7b79c326d5e195201c223075ae83b3b2a33ed565dd57f2da325b01d97c72e"}
Jul 09 17:09:39.861556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:39.861229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:09:39.884582 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:39.884534    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc" podStartSLOduration=1.884516444 podStartE2EDuration="1.884516444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:09:39.883750689 +0000 UTC m=+1139.217211816" watchObservedRunningTime="2026-07-09 17:09:39.884516444 +0000 UTC m=+1139.217977557"
Jul 09 17:09:50.870692 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:09:50.870652    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qkptc"
Jul 09 17:10:00.747034 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:00.746997    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:10:12.248488 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:12.248409    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:10:23.651547 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:23.651507    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:10:35.155536 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:35.155498    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:10:41.153425 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:41.153394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:10:41.155589 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:41.155561    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:10:41.157774 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:41.157753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:10:41.160408 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:41.160386    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:10:46.151169 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:46.151131    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:10:56.740577 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:10:56.740537    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:11:06.052654 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:11:06.052618    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:11:17.350423 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:11:17.350383    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:11:27.752678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:11:27.752646    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:11:37.151221 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:11:37.151185    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:11:47.839737 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:11:47.839701    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:12:14.141481 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:12:14.141444    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:12:21.687011 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:12:21.686977    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:12:31.352252 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:12:31.346696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:12:42.449104 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:12:42.449072    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:12:51.646327 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:12:51.646289    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:03.651629 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:03.651542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:14.149806 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:14.149768    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:23.451924 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:23.451885    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:32.654015 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:32.653978    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:43.653650 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:43.653609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:13:53.352957 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:13:53.352914    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:06.650654 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:06.650622    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:15.945373 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:15.945341    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:25.447321 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:25.447291    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:34.646788 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:34.646701    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:47.146520 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:47.146482    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:14:56.243971 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:14:56.243931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:15:08.046316 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:08.046280    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:15:19.049245 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:19.049205    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:15:31.545000 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:31.544966    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:15:41.196292 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:41.196261    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:15:41.200221 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:41.200196    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:15:41.201446 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:41.201423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:15:41.205037 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:41.205013    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:15:43.357142 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:43.357106    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:15:52.348684 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:15:52.348645    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:16:01.759096 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:01.759060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:16:02.657626 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.657530    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:02.661748 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.661717    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.667942 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.667912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b36b5c42-openshift-default-dockercfg-5z6xj\""
Jul 09 17:16:02.678602 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.678575    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:02.709038 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709006    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5lg\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709152    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709405 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709405 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.709405 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.709258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810021 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.809980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5lg\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810045    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810102    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810483 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810650    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810675    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.810979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.810930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.811304 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.811280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.812969 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.812944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.813133 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.813116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.819487 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.819465    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.819911 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.819887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5lg\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg\") pod \"e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") " pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:02.974037 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:02.973938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:03.118157 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.118132    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:03.120292 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:16:03.120258    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f3a00d_d9fe_4adf_8161_c08f1ebcbf90.slice/crio-7ab53c68b3ec0a581b4526f846cdce4f6c7aa500b555e07596b34300cd8b011c WatchSource:0}: Error finding container 7ab53c68b3ec0a581b4526f846cdce4f6c7aa500b555e07596b34300cd8b011c: Status 404 returned error can't find the container with id 7ab53c68b3ec0a581b4526f846cdce4f6c7aa500b555e07596b34300cd8b011c
Jul 09 17:16:03.123002 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.122972    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:03.123095 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.123050    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:03.123159 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.123095    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:03.858905 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.858789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" event={"ID":"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90","Type":"ContainerStarted","Data":"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"}
Jul 09 17:16:03.858905 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.858885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" event={"ID":"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90","Type":"ContainerStarted","Data":"7ab53c68b3ec0a581b4526f846cdce4f6c7aa500b555e07596b34300cd8b011c"}
Jul 09 17:16:03.888355 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.888301    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" podStartSLOduration=1.888284133 podStartE2EDuration="1.888284133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:03.886342392 +0000 UTC m=+1523.219803528" watchObservedRunningTime="2026-07-09 17:16:03.888284133 +0000 UTC m=+1523.221745247"
Jul 09 17:16:03.974910 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:03.974878    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:04.979500 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:04.979468    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:05.871787 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:05.871759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:05.872894 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:05.872877    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:09.063560 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:09.063521    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:09.064000 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:09.063731    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" podUID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" containerName="istio-proxy" containerID="cri-o://4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c" gracePeriod=30
Jul 09 17:16:14.717656 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.717631    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:14.823146 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823070    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823146 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823122    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823159    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n5lg\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823181    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823204    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823222    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823244    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823330    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket\") pod \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\" (UID: \"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90\") "
Jul 09 17:16:14.823362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823334    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:14.823746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823562    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.823746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823681    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:14.823880 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823756    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:14.823880 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.823865    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:14.824284 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.824256    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data" (OuterVolumeSpecName: "istio-data") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:14.825595 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.825564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg" (OuterVolumeSpecName: "kube-api-access-4n5lg") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "kube-api-access-4n5lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:14.825595 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.825564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:14.825734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.825602    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:16:14.825734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.825660    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token" (OuterVolumeSpecName: "istio-token") pod "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" (UID: "84f3a00d-d9fe-4adf-8161-c08f1ebcbf90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:14.924825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924787    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.924825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924820    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.924825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924862    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n5lg\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-kube-api-access-4n5lg\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.924825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924874    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.925124 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924886    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.925124 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924898    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.925124 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924910    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.925124 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.924921    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:14.928719 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.928686    2570 generic.go:356] "Generic (PLEG): container finished" podID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" containerID="4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c" exitCode=0
Jul 09 17:16:14.928865 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.928738    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"
Jul 09 17:16:14.928865 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.928773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" event={"ID":"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90","Type":"ContainerDied","Data":"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"}
Jul 09 17:16:14.928941 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.928872    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b" event={"ID":"84f3a00d-d9fe-4adf-8161-c08f1ebcbf90","Type":"ContainerDied","Data":"7ab53c68b3ec0a581b4526f846cdce4f6c7aa500b555e07596b34300cd8b011c"}
Jul 09 17:16:14.928941 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.928897    2570 scope.go:117] "RemoveContainer" containerID="4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"
Jul 09 17:16:14.938941 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.938920    2570 scope.go:117] "RemoveContainer" containerID="4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"
Jul 09 17:16:14.939228 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:16:14.939204    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c\": container with ID starting with 4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c not found: ID does not exist" containerID="4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"
Jul 09 17:16:14.939318 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.939241    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c"} err="failed to get container status \"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c\": rpc error: code = NotFound desc = could not find container \"4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c\": container with ID starting with 4421ae8f6ec145259a65251a14e810a083d13ac26adeaa58bd6a8bbda864ff3c not found: ID does not exist"
Jul 09 17:16:14.959014 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.958985    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:14.968447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.968419    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b36b5c42-openshift-default-6d4575fcf7-hw87b"]
Jul 09 17:16:14.990324 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.990294    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:14.990815 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.990797    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" containerName="istio-proxy"
Jul 09 17:16:14.990815 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.990816    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" containerName="istio-proxy"
Jul 09 17:16:14.990981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.990940    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" containerName="istio-proxy"
Jul 09 17:16:14.995559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.995541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:14.998282 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:14.998263    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-95b1a2a3-openshift-default-dockercfg-mz42b\""
Jul 09 17:16:15.005110 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.005088    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:15.025482 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025609 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025609 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025609 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025609 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.025746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.025699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc8dg\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126520 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8dg\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.126981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.127128 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.126999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.127128 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.127044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.127234 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.127182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.127234 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.127180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.127621 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.127598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.128932 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.128912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.129040 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.129022    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.135316 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.135294    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.135555 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.135538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8dg\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg\") pod \"e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") " pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.190210 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.190181    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f3a00d-d9fe-4adf-8161-c08f1ebcbf90" path="/var/lib/kubelet/pods/84f3a00d-d9fe-4adf-8161-c08f1ebcbf90/volumes"
Jul 09 17:16:15.307373 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.307335    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:15.445818 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.445789    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:15.447716 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:16:15.447691    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15086b6_10bb_4249_9869_d65ec6061e78.slice/crio-b66c203680c1af4d081fad7cfaeed1405c1a73b8c3d4eeb38316ff9c036ef518 WatchSource:0}: Error finding container b66c203680c1af4d081fad7cfaeed1405c1a73b8c3d4eeb38316ff9c036ef518: Status 404 returned error can't find the container with id b66c203680c1af4d081fad7cfaeed1405c1a73b8c3d4eeb38316ff9c036ef518
Jul 09 17:16:15.449958 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.449929    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:15.450024 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.449993    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:15.450024 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.450021    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:15.936555 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.936512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" event={"ID":"e15086b6-10bb-4249-9869-d65ec6061e78","Type":"ContainerStarted","Data":"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"}
Jul 09 17:16:15.937023 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.936586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" event={"ID":"e15086b6-10bb-4249-9869-d65ec6061e78","Type":"ContainerStarted","Data":"b66c203680c1af4d081fad7cfaeed1405c1a73b8c3d4eeb38316ff9c036ef518"}
Jul 09 17:16:15.967262 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:15.967212    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" podStartSLOduration=1.967196381 podStartE2EDuration="1.967196381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:15.964332531 +0000 UTC m=+1535.297793693" watchObservedRunningTime="2026-07-09 17:16:15.967196381 +0000 UTC m=+1535.300657494"
Jul 09 17:16:16.308152 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:16.308072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:16.313430 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:16.313404    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:16.943724 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:16.943678    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:16.944787 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:16.944763    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:19.846780 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:19.846735    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:16:27.254264 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.254221    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:27.254744 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.254434    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" podUID="e15086b6-10bb-4249-9869-d65ec6061e78" containerName="istio-proxy" containerID="cri-o://580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd" gracePeriod=30
Jul 09 17:16:27.512321 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.512260    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:27.659479 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659446    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659643 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659643 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659537    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659643 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659567    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659643 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659600    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659643 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659635    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659707    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659743    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc8dg\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg\") pod \"e15086b6-10bb-4249-9869-d65ec6061e78\" (UID: \"e15086b6-10bb-4249-9869-d65ec6061e78\") "
Jul 09 17:16:27.659956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659804    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:27.659956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.659926    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:27.660209 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:27.660209 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660166    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.660209 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660186    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.660209 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660201    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.660415 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660329    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:27.660664 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.660638    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data" (OuterVolumeSpecName: "istio-data") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:27.661818 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.661790    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:16:27.661966 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.661945    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg" (OuterVolumeSpecName: "kube-api-access-tc8dg") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "kube-api-access-tc8dg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:27.662210 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.662183    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token" (OuterVolumeSpecName: "istio-token") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:27.662294 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.662210    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e15086b6-10bb-4249-9869-d65ec6061e78" (UID: "e15086b6-10bb-4249-9869-d65ec6061e78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:27.761434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761398    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.761434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761427    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e15086b6-10bb-4249-9869-d65ec6061e78-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.761434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761438    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.761667 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761449    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e15086b6-10bb-4249-9869-d65ec6061e78-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.761667 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761461    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e15086b6-10bb-4249-9869-d65ec6061e78-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:27.761667 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:27.761471    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc8dg\" (UniqueName: \"kubernetes.io/projected/e15086b6-10bb-4249-9869-d65ec6061e78-kube-api-access-tc8dg\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:28.001542 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.001503    2570 generic.go:356] "Generic (PLEG): container finished" podID="e15086b6-10bb-4249-9869-d65ec6061e78" containerID="580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd" exitCode=0
Jul 09 17:16:28.001734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.001549    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"
Jul 09 17:16:28.001734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.001593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" event={"ID":"e15086b6-10bb-4249-9869-d65ec6061e78","Type":"ContainerDied","Data":"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"}
Jul 09 17:16:28.001734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.001643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx" event={"ID":"e15086b6-10bb-4249-9869-d65ec6061e78","Type":"ContainerDied","Data":"b66c203680c1af4d081fad7cfaeed1405c1a73b8c3d4eeb38316ff9c036ef518"}
Jul 09 17:16:28.001734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.001665    2570 scope.go:117] "RemoveContainer" containerID="580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"
Jul 09 17:16:28.011976 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.011959    2570 scope.go:117] "RemoveContainer" containerID="580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"
Jul 09 17:16:28.012244 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:16:28.012226    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd\": container with ID starting with 580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd not found: ID does not exist" containerID="580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"
Jul 09 17:16:28.012284 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.012252    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd"} err="failed to get container status \"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd\": rpc error: code = NotFound desc = could not find container \"580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd\": container with ID starting with 580cd7060a0a450ebcf45cbe788a8b6a8bc97bec564ac9fe3ad110ac35869edd not found: ID does not exist"
Jul 09 17:16:28.025239 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.025210    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:28.029403 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:28.029380    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-95b1a2a3-openshift-default-6c646c6b7f-khvfx"]
Jul 09 17:16:29.188454 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:29.188420    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15086b6-10bb-4249-9869-d65ec6061e78" path="/var/lib/kubelet/pods/e15086b6-10bb-4249-9869-d65ec6061e78/volumes"
Jul 09 17:16:31.947463 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:31.947429    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:16:33.178797 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.178757    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:33.179819 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.179785    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15086b6-10bb-4249-9869-d65ec6061e78" containerName="istio-proxy"
Jul 09 17:16:33.179819 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.179813    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15086b6-10bb-4249-9869-d65ec6061e78" containerName="istio-proxy"
Jul 09 17:16:33.180021 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.179931    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15086b6-10bb-4249-9869-d65ec6061e78" containerName="istio-proxy"
Jul 09 17:16:33.183176 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.183155    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.186072 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.186049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-65c0e4ad-openshift-default-dockercfg-dxtjf\""
Jul 09 17:16:33.196626 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.196597    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:33.315936 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.315893    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316095    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sb8x\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316295 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316295 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316295 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.316295 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.316276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417161 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417161 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sb8x\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.417416 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417634    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.417765    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.418404 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.418379    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.419642 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.419616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.419802 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.419781    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.428136 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.428114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sb8x\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.428244 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.428142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token\") pod \"e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") " pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.497189 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.497085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:33.633851 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.633802    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:33.635542 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:16:33.635519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae447e4f_60ea_4ec8_9e18_e9ae6fe7cfc3.slice/crio-2b96487b15fc86a460220e0ca402acb91283dc4efb5685d2b2ace167ffea5e0e WatchSource:0}: Error finding container 2b96487b15fc86a460220e0ca402acb91283dc4efb5685d2b2ace167ffea5e0e: Status 404 returned error can't find the container with id 2b96487b15fc86a460220e0ca402acb91283dc4efb5685d2b2ace167ffea5e0e
Jul 09 17:16:33.637565 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.637538    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:33.637624 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.637600    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:33.637660 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:33.637629    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:16:34.039464 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.039427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" event={"ID":"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3","Type":"ContainerStarted","Data":"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"}
Jul 09 17:16:34.039647 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.039483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" event={"ID":"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3","Type":"ContainerStarted","Data":"2b96487b15fc86a460220e0ca402acb91283dc4efb5685d2b2ace167ffea5e0e"}
Jul 09 17:16:34.065521 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.065474    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" podStartSLOduration=1.065457846 podStartE2EDuration="1.065457846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:34.063758996 +0000 UTC m=+1553.397220110" watchObservedRunningTime="2026-07-09 17:16:34.065457846 +0000 UTC m=+1553.398919026"
Jul 09 17:16:34.497231 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.497199    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:34.498614 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.498588    2570 patch_prober.go:28] interesting pod/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 17:16:34.498743 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:34.498640    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 17:16:35.501864 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:35.501817    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:36.050202 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:36.050173    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:36.051086 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:36.051067    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:38.914929 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:38.914895    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:39.065142 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:39.065096    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerName="istio-proxy" containerID="cri-o://251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f" gracePeriod=30
Jul 09 17:16:44.320152 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.320123    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:44.409197 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409165    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409223    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409254    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409309    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sb8x\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409346    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409394    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409444    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409559 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409479    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket\") pod \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\" (UID: \"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3\") "
Jul 09 17:16:44.409765 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:44.409765 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:44.409765 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409709    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:44.410007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409782    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:44.410007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409799    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.410007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409819    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.410007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409848    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.410007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.409996    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:16:44.411616 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.411591    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:16:44.411722 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.411605    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x" (OuterVolumeSpecName: "kube-api-access-7sb8x") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "kube-api-access-7sb8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:44.411871 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.411846    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:16:44.412008 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.411987    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" (UID: "ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:16:44.511142 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511098    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.511142 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511135    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.511142 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511148    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sb8x\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-kube-api-access-7sb8x\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.511390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511162    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.511390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511174    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:44.511390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:44.511185    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:16:45.097725 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.097687    2570 generic.go:356] "Generic (PLEG): container finished" podID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerID="251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f" exitCode=0
Jul 09 17:16:45.097725 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.097729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" event={"ID":"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3","Type":"ContainerDied","Data":"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"}
Jul 09 17:16:45.098036 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.097738    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"
Jul 09 17:16:45.098036 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.097773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb" event={"ID":"ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3","Type":"ContainerDied","Data":"2b96487b15fc86a460220e0ca402acb91283dc4efb5685d2b2ace167ffea5e0e"}
Jul 09 17:16:45.098036 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.097795    2570 scope.go:117] "RemoveContainer" containerID="251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"
Jul 09 17:16:45.114979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.114941    2570 scope.go:117] "RemoveContainer" containerID="251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"
Jul 09 17:16:45.115215 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:16:45.115190    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f\": container with ID starting with 251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f not found: ID does not exist" containerID="251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"
Jul 09 17:16:45.115292 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.115226    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f"} err="failed to get container status \"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f\": rpc error: code = NotFound desc = could not find container \"251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f\": container with ID starting with 251e571321ca743bc42991b5e0309ecfd5da09b05ac1efb88b448808dc321e5f not found: ID does not exist"
Jul 09 17:16:45.125471 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.125441    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:45.128859 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.128826    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-65c0e4ad-openshift-default-69fc68684c-txdwb"]
Jul 09 17:16:45.189028 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:16:45.188990    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" path="/var/lib/kubelet/pods/ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3/volumes"
Jul 09 17:18:07.349116 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:07.349076    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:18:16.449572 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:16.449541    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:18:20.186684 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.186650    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:20.187071 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.186998    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerName="istio-proxy"
Jul 09 17:18:20.187071 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.187010    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerName="istio-proxy"
Jul 09 17:18:20.187165 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.187079    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae447e4f-60ea-4ec8-9e18-e9ae6fe7cfc3" containerName="istio-proxy"
Jul 09 17:18:20.190105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.190086    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.192658 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.192635    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-895137fa-openshift-default-dockercfg-mncrg\""
Jul 09 17:18:20.215908 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.215886    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:20.359962 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.359925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.359962 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.359964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360251 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360251 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360251 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttb4x\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360251 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360406 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360272    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360406 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.360406 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.360359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461504 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461504 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461504 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttb4x\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.461752 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.462092 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.461919    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.462224 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.462184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.462303 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.462224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.462303 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.462286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.462381 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.462301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.463573 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.463545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.463920 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.463904    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.470133 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.470115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.470506 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.470482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttb4x\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x\") pod \"e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") " pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.503344 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.503314    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:20.642659 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.642631    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:20.644856 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:18:20.644793    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5cd9e7_7102_4336_b16c_eaf9d5dfaa28.slice/crio-27588462c2b0ca5db444abd562e5ddb152729033f18f022af2bc50e32884652c WatchSource:0}: Error finding container 27588462c2b0ca5db444abd562e5ddb152729033f18f022af2bc50e32884652c: Status 404 returned error can't find the container with id 27588462c2b0ca5db444abd562e5ddb152729033f18f022af2bc50e32884652c
Jul 09 17:18:20.647259 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.647224    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:20.647351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.647312    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:20.647421 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:20.647356    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:21.580794 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:21.580750    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerStarted","Data":"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"}
Jul 09 17:18:21.581303 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:21.580806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerStarted","Data":"27588462c2b0ca5db444abd562e5ddb152729033f18f022af2bc50e32884652c"}
Jul 09 17:18:21.604392 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:21.604344    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" podStartSLOduration=1.604329562 podStartE2EDuration="1.604329562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:18:21.601484046 +0000 UTC m=+1660.934945182" watchObservedRunningTime="2026-07-09 17:18:21.604329562 +0000 UTC m=+1660.937790676"
Jul 09 17:18:22.504141 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:22.504111    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:22.508690 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:22.508661    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:22.585634 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:22.585607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:22.586587 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:22.586566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:30.153203 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:30.153170    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:18:37.861296 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:37.860415    2570 patch_prober.go:28] interesting pod/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:58206->10.132.0.45:15021: read: connection reset by peer" start-of-body=
Jul 09 17:18:37.861296 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:37.860491    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:58206->10.132.0.45:15021: read: connection reset by peer"
Jul 09 17:18:38.675505 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.675475    2570 generic.go:356] "Generic (PLEG): container finished" podID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerID="ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9" exitCode=0
Jul 09 17:18:38.675505 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.675510    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerDied","Data":"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"}
Jul 09 17:18:38.675905 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.675888    2570 scope.go:117] "RemoveContainer" containerID="ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"
Jul 09 17:18:38.676887 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.676856    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:38.676996 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.676924    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:38.676996 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:38.676976    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:18:39.682472 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:39.682437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerStarted","Data":"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"}
Jul 09 17:18:40.503775 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:40.503742    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:40.504390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:40.504043    2570 patch_prober.go:28] interesting pod/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 17:18:40.504390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:40.504102    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 17:18:40.846657 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:40.846569    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:18:41.504759 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:41.504704    2570 patch_prober.go:28] interesting pod/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 17:18:41.505090 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:41.505056    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 17:18:41.728799 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:41.728764    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:41.729110 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:41.729081    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy" containerID="cri-o://e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef" gracePeriod=30
Jul 09 17:18:48.889864 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:48.889824    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:49.023263 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023170    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023263 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023263 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023246    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023300    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023379    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttb4x\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023411    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023445    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023472    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023495    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token\") pod \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\" (UID: \"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28\") "
Jul 09 17:18:49.023517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023478    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023543    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023654    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023775    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023793    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023806    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.023919 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.023895    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:18:49.024349 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.024329    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:18:49.026148 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.026113    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:18:49.026252 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.026186    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:18:49.026252 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.026196    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:18:49.026252 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.026201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x" (OuterVolumeSpecName: "kube-api-access-ttb4x") pod "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" (UID: "dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28"). InnerVolumeSpecName "kube-api-access-ttb4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:18:49.124467 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124436    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttb4x\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-kube-api-access-ttb4x\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.124467 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124462    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.124467 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124471    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.124697 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124481    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.124697 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124512    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.124697 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.124521    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:18:49.742208 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.742173    2570 generic.go:356] "Generic (PLEG): container finished" podID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerID="e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef" exitCode=0
Jul 09 17:18:49.742384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.742216    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"
Jul 09 17:18:49.742384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.742255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerDied","Data":"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"}
Jul 09 17:18:49.742384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.742314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq" event={"ID":"dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28","Type":"ContainerDied","Data":"27588462c2b0ca5db444abd562e5ddb152729033f18f022af2bc50e32884652c"}
Jul 09 17:18:49.742384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.742338    2570 scope.go:117] "RemoveContainer" containerID="e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"
Jul 09 17:18:49.751497 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.751299    2570 scope.go:117] "RemoveContainer" containerID="ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"
Jul 09 17:18:49.759347 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.759328    2570 scope.go:117] "RemoveContainer" containerID="e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"
Jul 09 17:18:49.759623 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:18:49.759598    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef\": container with ID starting with e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef not found: ID does not exist" containerID="e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"
Jul 09 17:18:49.759682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.759635    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef"} err="failed to get container status \"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef\": rpc error: code = NotFound desc = could not find container \"e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef\": container with ID starting with e9b23653e20740a1143a6add499a3d99724f1023a726465eebead59bbc7a54ef not found: ID does not exist"
Jul 09 17:18:49.759682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.759658    2570 scope.go:117] "RemoveContainer" containerID="ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"
Jul 09 17:18:49.759949 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:18:49.759925    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9\": container with ID starting with ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9 not found: ID does not exist" containerID="ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"
Jul 09 17:18:49.760028 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.759959    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9"} err="failed to get container status \"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9\": rpc error: code = NotFound desc = could not find container \"ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9\": container with ID starting with ffe7b70faae2fe9a727783618646f6cdb9c68aa5fa68e27b40f3e912291a20e9 not found: ID does not exist"
Jul 09 17:18:49.761588 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.761569    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:49.766775 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:49.766750    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-895137fa-openshift-default-6588b49bdc-fgjnq"]
Jul 09 17:18:51.190035 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:18:51.190004    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" path="/var/lib/kubelet/pods/dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28/volumes"
Jul 09 17:19:01.146496 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.146449    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:19:01.147065 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.146958    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.147065 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.146975    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.147065 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.146990    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.147065 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.146998    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.147280 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.147072    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.147280 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.147083    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd5cd9e7-7102-4336-b16c-eaf9d5dfaa28" containerName="istio-proxy"
Jul 09 17:19:01.151473 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.151454    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.154046 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.154029    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b9b28345-openshift-default-dockercfg-nqd5b\""
Jul 09 17:19:01.164368 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.164348    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:19:01.326220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326181    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326268    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326525 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326525 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326525 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4s8\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.326525 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.326494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427288 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427288 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427288 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4s8\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427452    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427927 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.427927 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.427884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.428172 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.428144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.428236 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.428181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.428236 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.428210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.429694 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.429671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.430056 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.430033    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.435614 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.435589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.436126 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.436108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4s8\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8\") pod \"e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") " pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.461601 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.461576    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:01.603587 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.603557    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:19:01.606417 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:19:01.606387    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cefadd_8aa7_4a6d_9afe_f337ca57155e.slice/crio-6edd7fbdf7248aa13052386163d54fac618eee72a1d5d50e7ffd364f6c372476 WatchSource:0}: Error finding container 6edd7fbdf7248aa13052386163d54fac618eee72a1d5d50e7ffd364f6c372476: Status 404 returned error can't find the container with id 6edd7fbdf7248aa13052386163d54fac618eee72a1d5d50e7ffd364f6c372476
Jul 09 17:19:01.609128 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.609092    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:01.609239 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.609160    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:01.609239 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.609188    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:01.818747 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.818642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerStarted","Data":"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"}
Jul 09 17:19:01.818747 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.818716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerStarted","Data":"6edd7fbdf7248aa13052386163d54fac618eee72a1d5d50e7ffd364f6c372476"}
Jul 09 17:19:01.839018 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:01.838965    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podStartSLOduration=0.83894793 podStartE2EDuration="838.94793ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:19:01.837459454 +0000 UTC m=+1701.170920592" watchObservedRunningTime="2026-07-09 17:19:01.83894793 +0000 UTC m=+1701.172409044"
Jul 09 17:19:02.462531 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:02.462498    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:02.463994 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:02.463963    2570 patch_prober.go:28] interesting pod/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 17:19:02.464102 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:02.464023    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 17:19:03.465437 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:03.465406    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:03.829154 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:03.829044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:03.829950 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:03.829927    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:10.047083 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:10.047046    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:19:17.904268 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.904232    2570 generic.go:356] "Generic (PLEG): container finished" podID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerID="30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1" exitCode=0
Jul 09 17:19:17.904815 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.904297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerDied","Data":"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"}
Jul 09 17:19:17.904915 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.904875    2570 scope.go:117] "RemoveContainer" containerID="30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"
Jul 09 17:19:17.905898 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.905866    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:17.906003 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.905936    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:17.906003 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:17.905969    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:19:18.829930 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:18.829890    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:18.915820 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:18.915773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerStarted","Data":"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"}
Jul 09 17:19:19.462679 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:19.462647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:19.463758 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:19.463731    2570 patch_prober.go:28] interesting pod/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 17:19:19.463890 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:19.463781    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 17:19:20.462162 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:20.462133    2570 patch_prober.go:28] interesting pod/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 17:19:20.462578 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:20.462190    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 17:19:21.462373 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:21.462338    2570 patch_prober.go:28] interesting pod/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 17:19:21.462744 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:21.462389    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 17:19:22.462667 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:22.462628    2570 patch_prober.go:28] interesting pod/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 17:19:22.463082 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:22.462687    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 17:19:23.466251 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:23.466214    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:23.466680 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:23.466495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:23.467242 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:23.467222    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:19:25.459512 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:25.459475    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:19:40.643956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:40.643921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:19:51.053208 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:19:51.053169    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:20:00.448759 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:00.448725    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:20:36.452425 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:36.452338    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:20:39.453462 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:39.453425    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:20:39.453862 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:39.453726    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy" containerID="cri-o://307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77" gracePeriod=30
Jul 09 17:20:41.237977 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:41.237950    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:20:41.240506 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:41.240485    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:20:41.242647 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:41.242623    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:20:41.245177 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:41.245159    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:20:44.718139 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.718084    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:20:44.765188 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765197    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765252    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765268    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765291    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765362 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765319    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk4s8\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765596 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765366    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765596 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765399    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765596 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765422    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy\") pod \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\" (UID: \"50cefadd-8aa7-4a6d-9afe-f337ca57155e\") "
Jul 09 17:20:44.765596 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765430    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:20:44.765791 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765633    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:20:44.765791 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765696    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.765791 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765718    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.765965 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765918    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:20:44.766017 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.765989    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:20:44.766107 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.766084    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data" (OuterVolumeSpecName: "istio-data") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:20:44.767591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.767560    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token" (OuterVolumeSpecName: "istio-token") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:20:44.767722 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.767639    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:20:44.767722 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.767682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8" (OuterVolumeSpecName: "kube-api-access-jk4s8") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "kube-api-access-jk4s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:20:44.767895 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.767872    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50cefadd-8aa7-4a6d-9afe-f337ca57155e" (UID: "50cefadd-8aa7-4a6d-9afe-f337ca57155e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:20:44.866076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866041    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk4s8\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-kube-api-access-jk4s8\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866069    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866079    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866088    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866098    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866107    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:44.866333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:44.866115    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50cefadd-8aa7-4a6d-9afe-f337ca57155e-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:20:45.361180 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.361145    2570 generic.go:356] "Generic (PLEG): container finished" podID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerID="307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77" exitCode=0
Jul 09 17:20:45.361374 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.361198    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"
Jul 09 17:20:45.361374 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.361229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerDied","Data":"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"}
Jul 09 17:20:45.361374 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.361285    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg" event={"ID":"50cefadd-8aa7-4a6d-9afe-f337ca57155e","Type":"ContainerDied","Data":"6edd7fbdf7248aa13052386163d54fac618eee72a1d5d50e7ffd364f6c372476"}
Jul 09 17:20:45.361374 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.361308    2570 scope.go:117] "RemoveContainer" containerID="307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"
Jul 09 17:20:45.370695 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.370682    2570 scope.go:117] "RemoveContainer" containerID="30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"
Jul 09 17:20:45.379327 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.379221    2570 scope.go:117] "RemoveContainer" containerID="307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"
Jul 09 17:20:45.379569 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:20:45.379538    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77\": container with ID starting with 307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77 not found: ID does not exist" containerID="307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"
Jul 09 17:20:45.379723 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.379580    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77"} err="failed to get container status \"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77\": rpc error: code = NotFound desc = could not find container \"307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77\": container with ID starting with 307e107013c4da75c2a974fb691d0bd652fceab695167a2c296a1ca46c45cf77 not found: ID does not exist"
Jul 09 17:20:45.379723 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.379604    2570 scope.go:117] "RemoveContainer" containerID="30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"
Jul 09 17:20:45.379919 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:20:45.379889    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1\": container with ID starting with 30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1 not found: ID does not exist" containerID="30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"
Jul 09 17:20:45.379960 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.379913    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1"} err="failed to get container status \"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1\": rpc error: code = NotFound desc = could not find container \"30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1\": container with ID starting with 30b658f434620f3f4956f624f8bac8fe0a1f5153b140e4ffcb1d4c01b6080cc1 not found: ID does not exist"
Jul 09 17:20:45.381806 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.381788    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:20:45.390448 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:45.390424    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b9b28345-openshift-default-84d5d857dc-9gzfg"]
Jul 09 17:20:47.188357 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:20:47.188324    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" path="/var/lib/kubelet/pods/50cefadd-8aa7-4a6d-9afe-f337ca57155e/volumes"
Jul 09 17:21:33.814624 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.814587    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.814985    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.814998    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.815023    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.815031    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.815103    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.815399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.815115    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cefadd-8aa7-4a6d-9afe-f337ca57155e" containerName="istio-proxy"
Jul 09 17:21:33.818230 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.818212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.820969 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.820947    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-034dd4-openshift-default-dockercfg-lb6vz\""
Jul 09 17:21:33.830229 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.830208    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:21:33.988844 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.988786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.988862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.988897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.988940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989126 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.989045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989126 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.989090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989126 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.989109    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989226 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.989126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tg4\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:33.989226 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:33.989182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090260 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090260 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090260 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090260 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090604 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090604 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090604 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090604 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090604 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tg4\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090884 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090884 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.090884 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.091002 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.090926    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.091236 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.091214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.092689 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.092667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.092959 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.092938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.098246 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.098218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.098330 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.098265    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tg4\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4\") pod \"e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") " pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.128932 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.128904    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:34.270005 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.269976    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:21:34.271469 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:21:34.271442    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b14873_458b_4725_9526_05b2d4e757b5.slice/crio-e2729c5daa1785e25d1b1818ee3c3ad587353c9b280af51b4c8e1eb3db5dd0fb WatchSource:0}: Error finding container e2729c5daa1785e25d1b1818ee3c3ad587353c9b280af51b4c8e1eb3db5dd0fb: Status 404 returned error can't find the container with id e2729c5daa1785e25d1b1818ee3c3ad587353c9b280af51b4c8e1eb3db5dd0fb
Jul 09 17:21:34.273948 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.273917    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:34.274025 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.273982    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:34.274025 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.274017    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:34.607878 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.607821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerStarted","Data":"bcc7ab605aa2a3c7da48146713c5f480b8eb6b7c89b09c26ff3e9e6c9ad90e20"}
Jul 09 17:21:34.608028 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.607895    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerStarted","Data":"e2729c5daa1785e25d1b1818ee3c3ad587353c9b280af51b4c8e1eb3db5dd0fb"}
Jul 09 17:21:34.629500 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:34.629447    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podStartSLOduration=1.629430079 podStartE2EDuration="1.629430079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:34.629273438 +0000 UTC m=+1853.962734556" watchObservedRunningTime="2026-07-09 17:21:34.629430079 +0000 UTC m=+1853.962891193"
Jul 09 17:21:35.129700 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:35.129667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:35.134594 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:35.134563    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:35.613679 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:35.613598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:35.614580 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:35.614557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:41.662002 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.661966    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:21:41.667107 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.667085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.669658 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.669641    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-90e561-openshift-default-dockercfg-64d7h\""
Jul 09 17:21:41.678288 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.678260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:21:41.765991 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.765951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766172 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.765999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wln8\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766172 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766172 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766104    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766334 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766334 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766334 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766334 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.766334 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.766328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.866726 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.866726 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wln8\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867041 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.866931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867356 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.867204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867356 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.867215    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867519 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.867496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867582 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.867534    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.867870 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.867822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.869285 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.869267    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.869434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.869414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.875383 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.875361    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wln8\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.875909 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.875891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token\") pod \"e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") " pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:41.978001 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:41.977912    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:42.118409 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.118385    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:21:42.120652 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:21:42.120620    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc469f33_88a2_499c_9910_6c292ee66567.slice/crio-82abf3aa8fcac0720dacd344a3ea558ff693a2b8bc0b56b4a4c60852c81758cf WatchSource:0}: Error finding container 82abf3aa8fcac0720dacd344a3ea558ff693a2b8bc0b56b4a4c60852c81758cf: Status 404 returned error can't find the container with id 82abf3aa8fcac0720dacd344a3ea558ff693a2b8bc0b56b4a4c60852c81758cf
Jul 09 17:21:42.122938 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.122899    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:42.123053 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.122979    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:42.123053 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.123018    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:42.653007 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.652968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerStarted","Data":"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"}
Jul 09 17:21:42.653200 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.653045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerStarted","Data":"82abf3aa8fcac0720dacd344a3ea558ff693a2b8bc0b56b4a4c60852c81758cf"}
Jul 09 17:21:42.677556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.677506    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podStartSLOduration=1.677490779 podStartE2EDuration="1.677490779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:42.674730952 +0000 UTC m=+1862.008192109" watchObservedRunningTime="2026-07-09 17:21:42.677490779 +0000 UTC m=+1862.010951896"
Jul 09 17:21:42.978064 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:42.977979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:43.983061 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:43.983030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:44.664113 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:44.664086    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:44.665085 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:44.665063    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:21:44.856185 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:44.856148    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:21:51.657003 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:51.656963    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 17:21:51.657454 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:51.657030    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 17:21:53.713667 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.713633    2570 generic.go:356] "Generic (PLEG): container finished" podID="86b14873-458b-4725-9526-05b2d4e757b5" containerID="bcc7ab605aa2a3c7da48146713c5f480b8eb6b7c89b09c26ff3e9e6c9ad90e20" exitCode=0
Jul 09 17:21:53.714220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.713704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerDied","Data":"bcc7ab605aa2a3c7da48146713c5f480b8eb6b7c89b09c26ff3e9e6c9ad90e20"}
Jul 09 17:21:53.714291 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.714253    2570 scope.go:117] "RemoveContainer" containerID="bcc7ab605aa2a3c7da48146713c5f480b8eb6b7c89b09c26ff3e9e6c9ad90e20"
Jul 09 17:21:53.715309 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.715277    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:53.715411 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.715348    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:53.715411 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:53.715382    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:21:54.721463 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:54.721429    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerStarted","Data":"544e492bf4d5c603fd57489c618f5e99f611e1af866deb7d62040755068b22e8"}
Jul 09 17:21:55.129342 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:55.129305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:21:55.129616 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:55.129597    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 17:21:55.129682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:55.129640    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 17:21:56.129990 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:56.129947    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 17:21:56.130607 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:56.130569    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 17:21:57.129537 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:57.129499    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 17:21:57.129900 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:57.129868    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 17:21:58.130146 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:58.130110    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 17:21:58.130750 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:58.130717    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 17:21:59.130368 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:59.130321    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 17:21:59.130914 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:59.130405    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 17:21:59.841119 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:21:59.841081    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:22:00.133591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:00.133558    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:22:00.134102 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:00.134080    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:22:00.134803 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:00.134780    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:22:00.705985 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:00.705947    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 17:22:00.706148 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:00.706007    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 17:22:02.773756 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.773717    2570 generic.go:356] "Generic (PLEG): container finished" podID="fc469f33-88a2-499c-9910-6c292ee66567" containerID="b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830" exitCode=0
Jul 09 17:22:02.774200 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.773792    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerDied","Data":"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"}
Jul 09 17:22:02.774243 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.774223    2570 scope.go:117] "RemoveContainer" containerID="b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"
Jul 09 17:22:02.775289 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.775264    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:22:02.775352 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.775330    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:22:02.775389 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:02.775359    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:22:03.781076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:03.780997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerStarted","Data":"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"}
Jul 09 17:22:03.978710 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:03.978669    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:22:03.978961 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:03.978913    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 17:22:03.979015 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:03.978963    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 17:22:04.978884 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:04.978820    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 17:22:04.979352 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:04.978911    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 17:22:05.978986 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:05.978953    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 17:22:05.979383 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:05.979006    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 17:22:06.978931 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:06.978898    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 17:22:06.979111 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:06.978952    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 17:22:07.981623 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:07.981593    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:22:07.982063 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:07.981867    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:22:07.982535 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:07.982519    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:22:15.477660 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:15.477621    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:22:25.839990 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:25.839955    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:22:40.045076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:40.045039    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:22:51.052868 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:22:51.052819    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:23:26.080920 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:26.080876    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:23:26.081446 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:26.081168    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" containerID="cri-o://544e492bf4d5c603fd57489c618f5e99f611e1af866deb7d62040755068b22e8" gracePeriod=30
Jul 09 17:23:30.053673 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:30.053637    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:23:30.136869 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:30.136823    2570 patch_prober.go:28] interesting pod/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 17:23:30.137033 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:30.136890    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:23:31.238781 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.238749    2570 generic.go:356] "Generic (PLEG): container finished" podID="86b14873-458b-4725-9526-05b2d4e757b5" containerID="544e492bf4d5c603fd57489c618f5e99f611e1af866deb7d62040755068b22e8" exitCode=0
Jul 09 17:23:31.239167 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.238816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerDied","Data":"544e492bf4d5c603fd57489c618f5e99f611e1af866deb7d62040755068b22e8"}
Jul 09 17:23:31.239167 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.238902    2570 scope.go:117] "RemoveContainer" containerID="bcc7ab605aa2a3c7da48146713c5f480b8eb6b7c89b09c26ff3e9e6c9ad90e20"
Jul 09 17:23:31.328979 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.328950    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:23:31.485880 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.485804    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.485890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.485912    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.485979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486007    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486030    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486322 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486082    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486322 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8tg4\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486322 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486207    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token\") pod \"86b14873-458b-4725-9526-05b2d4e757b5\" (UID: \"86b14873-458b-4725-9526-05b2d4e757b5\") "
Jul 09 17:23:31.486322 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486204    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:31.486531 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486323    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:31.486531 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486404    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:31.486531 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486469    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:23:31.486683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486591    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.486683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486608    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b14873-458b-4725-9526-05b2d4e757b5-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.486683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486619    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.486683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486631    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.487002 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.486976    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:31.488308 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.488284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:23:31.488414 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.488291    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4" (OuterVolumeSpecName: "kube-api-access-j8tg4") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "kube-api-access-j8tg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:31.488665 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.488646    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:31.488665 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.488652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "86b14873-458b-4725-9526-05b2d4e757b5" (UID: "86b14873-458b-4725-9526-05b2d4e757b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:31.587391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.587349    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8tg4\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-kube-api-access-j8tg4\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.587391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.587387    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b14873-458b-4725-9526-05b2d4e757b5-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.587391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.587398    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.587636 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.587406    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b14873-458b-4725-9526-05b2d4e757b5-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:31.587636 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:31.587414    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b14873-458b-4725-9526-05b2d4e757b5-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:32.245818 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:32.245783    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6" event={"ID":"86b14873-458b-4725-9526-05b2d4e757b5","Type":"ContainerDied","Data":"e2729c5daa1785e25d1b1818ee3c3ad587353c9b280af51b4c8e1eb3db5dd0fb"}
Jul 09 17:23:32.246241 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:32.245869    2570 scope.go:117] "RemoveContainer" containerID="544e492bf4d5c603fd57489c618f5e99f611e1af866deb7d62040755068b22e8"
Jul 09 17:23:32.246241 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:32.245790    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"
Jul 09 17:23:32.283646 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:32.283615    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:23:32.289232 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:32.289205    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-034dd4-openshift-default-ffdd8bcbc-7z6j6"]
Jul 09 17:23:33.188655 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:33.188619    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b14873-458b-4725-9526-05b2d4e757b5" path="/var/lib/kubelet/pods/86b14873-458b-4725-9526-05b2d4e757b5/volumes"
Jul 09 17:23:33.254351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:33.254319    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:23:33.254724 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:33.254528    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" containerID="cri-o://53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c" gracePeriod=30
Jul 09 17:23:37.497804 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.497751    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498159    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498172    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498190    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498195    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498252    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.498290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.498260    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b14873-458b-4725-9526-05b2d4e757b5" containerName="istio-proxy"
Jul 09 17:23:37.502964 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.502937    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.505530 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.505509    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-31f74d-serving-cert\""
Jul 09 17:23:37.505944 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.505927    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mpbsc\""
Jul 09 17:23:37.506046 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.505996    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 17:23:37.506768 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.506749    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 17:23:37.514517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.514494    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:23:37.645893 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.645825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.646071 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.645929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.646071 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.645964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbjk\" (UniqueName: \"kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.746808 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.746776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbjk\" (UniqueName: \"kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.747016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.746871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.747016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.746930    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.747524 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.747492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.749433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.749387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.754214 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.754193    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbjk\" (UniqueName: \"kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk\") pod \"maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.814183 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.814149    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:37.957628 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.957543    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:23:37.959328 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:23:37.959295    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65172420_da8c_48af_983e_2fdf6b2f5314.slice/crio-566f9b069c9f0cc8bc05c041e6aabc94457d84e95c3496ac895d4b616bb17218 WatchSource:0}: Error finding container 566f9b069c9f0cc8bc05c041e6aabc94457d84e95c3496ac895d4b616bb17218: Status 404 returned error can't find the container with id 566f9b069c9f0cc8bc05c041e6aabc94457d84e95c3496ac895d4b616bb17218
Jul 09 17:23:37.960615 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.960598    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:23:37.984606 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.984576    2570 patch_prober.go:28] interesting pod/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 17:23:37.984729 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:37.984625    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:23:38.286624 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.286584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" event={"ID":"65172420-da8c-48af-983e-2fdf6b2f5314","Type":"ContainerStarted","Data":"566f9b069c9f0cc8bc05c041e6aabc94457d84e95c3496ac895d4b616bb17218"}
Jul 09 17:23:38.503387 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.503365    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:23:38.654399 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654359    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654600 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654418    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654600 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654448    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654600 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654557    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wln8\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654600 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654593    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654866 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654866 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654707    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654866 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654739    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.654866 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.654780    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket\") pod \"fc469f33-88a2-499c-9910-6c292ee66567\" (UID: \"fc469f33-88a2-499c-9910-6c292ee66567\") "
Jul 09 17:23:38.655738 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.655697    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:38.655985 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.655909    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:38.655985 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.655924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:23:38.656926 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.656897    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:38.657042 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.656965    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:38.658063 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.658037    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:23:38.658397 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.658370    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:38.658868 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.658820    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:23:38.659201 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.659169    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8" (OuterVolumeSpecName: "kube-api-access-9wln8") pod "fc469f33-88a2-499c-9910-6c292ee66567" (UID: "fc469f33-88a2-499c-9910-6c292ee66567"). InnerVolumeSpecName "kube-api-access-9wln8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756289    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756314    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc469f33-88a2-499c-9910-6c292ee66567-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756323    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756332    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756343    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756351    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc469f33-88a2-499c-9910-6c292ee66567-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756358    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756366    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wln8\" (UniqueName: \"kubernetes.io/projected/fc469f33-88a2-499c-9910-6c292ee66567-kube-api-access-9wln8\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:38.756813 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:38.756396    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc469f33-88a2-499c-9910-6c292ee66567-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:39.295784 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.295748    2570 generic.go:356] "Generic (PLEG): container finished" podID="fc469f33-88a2-499c-9910-6c292ee66567" containerID="53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c" exitCode=0
Jul 09 17:23:39.296193 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.295815    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"
Jul 09 17:23:39.296351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.295864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerDied","Data":"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"}
Jul 09 17:23:39.296351 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.296334    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8" event={"ID":"fc469f33-88a2-499c-9910-6c292ee66567","Type":"ContainerDied","Data":"82abf3aa8fcac0720dacd344a3ea558ff693a2b8bc0b56b4a4c60852c81758cf"}
Jul 09 17:23:39.296471 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.296369    2570 scope.go:117] "RemoveContainer" containerID="53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"
Jul 09 17:23:39.316803 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.316754    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:23:39.320867 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.320825    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-90e561-openshift-default-86c956cb7-78wg8"]
Jul 09 17:23:39.590695 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.590674    2570 scope.go:117] "RemoveContainer" containerID="b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"
Jul 09 17:23:39.599279 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.599258    2570 scope.go:117] "RemoveContainer" containerID="53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"
Jul 09 17:23:39.599548 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:23:39.599525    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c\": container with ID starting with 53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c not found: ID does not exist" containerID="53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"
Jul 09 17:23:39.599607 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.599558    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c"} err="failed to get container status \"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c\": rpc error: code = NotFound desc = could not find container \"53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c\": container with ID starting with 53b42442f9f0cbec0ce256c9dc73fcde947ee9a766f6a215192e38a047ce872c not found: ID does not exist"
Jul 09 17:23:39.599607 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.599575    2570 scope.go:117] "RemoveContainer" containerID="b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"
Jul 09 17:23:39.599882 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:23:39.599852    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830\": container with ID starting with b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830 not found: ID does not exist" containerID="b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"
Jul 09 17:23:39.600010 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:39.599889    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830"} err="failed to get container status \"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830\": rpc error: code = NotFound desc = could not find container \"b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830\": container with ID starting with b6ebe2279d9115b911285b51477abd0b03baada232d1ffc9e9436c1d3a7d7830 not found: ID does not exist"
Jul 09 17:23:40.303390 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:40.303350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" event={"ID":"65172420-da8c-48af-983e-2fdf6b2f5314","Type":"ContainerStarted","Data":"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"}
Jul 09 17:23:40.303603 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:40.303467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:40.322196 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:40.322141    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" podStartSLOduration=1.636649952 podStartE2EDuration="3.322124729s" totalImagesPullingTime="1.685474777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:40.321288829 +0000 UTC m=+1979.654749946" watchObservedRunningTime="2026-07-09 17:23:40.322124729 +0000 UTC m=+1979.655585843"
Jul 09 17:23:41.196640 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:41.196600    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc469f33-88a2-499c-9910-6c292ee66567" path="/var/lib/kubelet/pods/fc469f33-88a2-499c-9910-6c292ee66567/volumes"
Jul 09 17:23:42.701034 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701001    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:23:42.701537 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701518    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:23:42.701586 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701542    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:23:42.701586 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701574    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:23:42.701586 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701584    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:23:42.701709 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.701697    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:23:42.706594 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.706575    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.709212 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.709189    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c494fe-openshift-default-dockercfg-p88c4\""
Jul 09 17:23:42.711166 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.711145    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:23:42.792222 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.792521 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.792742 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.792897 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792877    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.792976 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.792976 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.793074 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.792987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.793074 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.793016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.793180 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.793079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cd9r\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894558 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894767 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894767 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894767 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894975 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894975 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894975 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894915    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894975 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.894975 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.894962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cd9r\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.895203 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.895121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.895325 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.895293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.895396 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.895367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.895508 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.895489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.895845 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.895804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.897386 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.897358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.897629 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.897609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.906084 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.906053    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cd9r\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:42.906232 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:42.906208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token\") pod \"e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") " pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:43.018565 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.018474    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:43.051234 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.051197    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:23:43.157122 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.157095    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:23:43.158642 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:23:43.158614    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb4d81f_852f_4a9b_912a_aedccae7a8ee.slice/crio-dfb30899d65179095fdbe8a914b98fa73284f37a3108ed382e42e0bfc837f53f WatchSource:0}: Error finding container dfb30899d65179095fdbe8a914b98fa73284f37a3108ed382e42e0bfc837f53f: Status 404 returned error can't find the container with id dfb30899d65179095fdbe8a914b98fa73284f37a3108ed382e42e0bfc837f53f
Jul 09 17:23:43.160905 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.160871    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:43.160990 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.160951    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:43.161029 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.160995    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:43.322447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.322356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerStarted","Data":"9e5cb97ec4242ebfd81702c02fcb4dab302e35a68c8e3ad94186d9bd6ec9f473"}
Jul 09 17:23:43.322447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.322418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerStarted","Data":"dfb30899d65179095fdbe8a914b98fa73284f37a3108ed382e42e0bfc837f53f"}
Jul 09 17:23:43.345068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:43.345009    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podStartSLOduration=1.344986466 podStartE2EDuration="1.344986466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:43.341903128 +0000 UTC m=+1982.675364325" watchObservedRunningTime="2026-07-09 17:23:43.344986466 +0000 UTC m=+1982.678447582"
Jul 09 17:23:44.018679 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:44.018642    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:44.024136 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:44.024109    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:44.328583 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:44.328491    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:44.329545 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:44.329525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:46.314736 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:46.314693    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:57.408224 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.408189    2570 generic.go:356] "Generic (PLEG): container finished" podID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerID="9e5cb97ec4242ebfd81702c02fcb4dab302e35a68c8e3ad94186d9bd6ec9f473" exitCode=0
Jul 09 17:23:57.408695 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.408230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerDied","Data":"9e5cb97ec4242ebfd81702c02fcb4dab302e35a68c8e3ad94186d9bd6ec9f473"}
Jul 09 17:23:57.408695 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.408570    2570 scope.go:117] "RemoveContainer" containerID="9e5cb97ec4242ebfd81702c02fcb4dab302e35a68c8e3ad94186d9bd6ec9f473"
Jul 09 17:23:57.409636 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.409603    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:57.409734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.409678    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:57.409734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.409723    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:23:57.457550 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:57.457523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:23:58.421994 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.421077    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerStarted","Data":"9531d492a4b0579ede225dfbbecc8fcd5ada6ffd377ee52781e658fd752086f1"}
Jul 09 17:23:58.438017 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.437982    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:23:58.438206 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.438169    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" podUID="65172420-da8c-48af-983e-2fdf6b2f5314" containerName="maas-api" containerID="cri-o://f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71" gracePeriod=30
Jul 09 17:23:58.726727 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.726697    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:58.843011 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.842981    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxbjk\" (UniqueName: \"kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk\") pod \"65172420-da8c-48af-983e-2fdf6b2f5314\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") "
Jul 09 17:23:58.843220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.843057    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls\") pod \"65172420-da8c-48af-983e-2fdf6b2f5314\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") "
Jul 09 17:23:58.843220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.843094    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca\") pod \"65172420-da8c-48af-983e-2fdf6b2f5314\" (UID: \"65172420-da8c-48af-983e-2fdf6b2f5314\") "
Jul 09 17:23:58.843501 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.843471    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65172420-da8c-48af-983e-2fdf6b2f5314" (UID: "65172420-da8c-48af-983e-2fdf6b2f5314"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:23:58.845341 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.845313    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65172420-da8c-48af-983e-2fdf6b2f5314" (UID: "65172420-da8c-48af-983e-2fdf6b2f5314"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:23:58.845431 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.845367    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk" (OuterVolumeSpecName: "kube-api-access-dxbjk") pod "65172420-da8c-48af-983e-2fdf6b2f5314" (UID: "65172420-da8c-48af-983e-2fdf6b2f5314"). InnerVolumeSpecName "kube-api-access-dxbjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:23:58.944078 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.943998    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65172420-da8c-48af-983e-2fdf6b2f5314-openshift-service-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:58.944078 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.944028    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxbjk\" (UniqueName: \"kubernetes.io/projected/65172420-da8c-48af-983e-2fdf6b2f5314-kube-api-access-dxbjk\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:58.944078 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:58.944038    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65172420-da8c-48af-983e-2fdf6b2f5314-maas-api-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:23:59.019669 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.019618    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:59.020647 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.020615    2570 patch_prober.go:28] interesting pod/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 17:23:59.020762 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.020678    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 17:23:59.328615 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.328572    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:23:59.427268 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.427234    2570 generic.go:356] "Generic (PLEG): container finished" podID="65172420-da8c-48af-983e-2fdf6b2f5314" containerID="f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71" exitCode=0
Jul 09 17:23:59.427760 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.427282    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"
Jul 09 17:23:59.427760 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.427318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" event={"ID":"65172420-da8c-48af-983e-2fdf6b2f5314","Type":"ContainerDied","Data":"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"}
Jul 09 17:23:59.427760 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.427370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm" event={"ID":"65172420-da8c-48af-983e-2fdf6b2f5314","Type":"ContainerDied","Data":"566f9b069c9f0cc8bc05c041e6aabc94457d84e95c3496ac895d4b616bb17218"}
Jul 09 17:23:59.427760 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.427393    2570 scope.go:117] "RemoveContainer" containerID="f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"
Jul 09 17:23:59.436201 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.436188    2570 scope.go:117] "RemoveContainer" containerID="f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"
Jul 09 17:23:59.436449 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:23:59.436426    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71\": container with ID starting with f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71 not found: ID does not exist" containerID="f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"
Jul 09 17:23:59.436513 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.436460    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71"} err="failed to get container status \"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71\": rpc error: code = NotFound desc = could not find container \"f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71\": container with ID starting with f898a452cecadf179291b3472af35808f41122eef38d7aecf91a68653f4f1b71 not found: ID does not exist"
Jul 09 17:23:59.445287 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.445264    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:23:59.449820 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:23:59.449799    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-31f74d-79f7cd8777-b7vxm"]
Jul 09 17:24:00.019389 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:00.019344    2570 patch_prober.go:28] interesting pod/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 17:24:00.019562 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:00.019436    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 17:24:01.019624 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:01.019588    2570 patch_prober.go:28] interesting pod/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 17:24:01.020122 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:01.019640    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 17:24:01.189622 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:01.189587    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65172420-da8c-48af-983e-2fdf6b2f5314" path="/var/lib/kubelet/pods/65172420-da8c-48af-983e-2fdf6b2f5314/volumes"
Jul 09 17:24:02.019333 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:02.019291    2570 patch_prober.go:28] interesting pod/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 17:24:02.019514 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:02.019362    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 17:24:03.022988 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:03.022957    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:24:03.023854 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:03.023820    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:24:09.554240 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:09.554200    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:24:11.343497 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:11.343456    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:24:11.343981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:11.343699    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy" containerID="cri-o://9531d492a4b0579ede225dfbbecc8fcd5ada6ffd377ee52781e658fd752086f1" gracePeriod=30
Jul 09 17:24:14.841734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.841704    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:24:14.842350 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.842064    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65172420-da8c-48af-983e-2fdf6b2f5314" containerName="maas-api"
Jul 09 17:24:14.842350 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.842077    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="65172420-da8c-48af-983e-2fdf6b2f5314" containerName="maas-api"
Jul 09 17:24:14.842350 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.842152    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="65172420-da8c-48af-983e-2fdf6b2f5314" containerName="maas-api"
Jul 09 17:24:14.842350 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.842162    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc469f33-88a2-499c-9910-6c292ee66567" containerName="istio-proxy"
Jul 09 17:24:14.844103 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.844085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:14.846795 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.846773    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-553a9f-serving-cert\""
Jul 09 17:24:14.846954 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.846896    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 17:24:14.847805 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.847786    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 17:24:14.847940 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.847807    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mpbsc\""
Jul 09 17:24:14.854500 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.854478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:24:14.990018 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.989982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k695\" (UniqueName: \"kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:14.990192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.990031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:14.990192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:14.990151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.090656 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.090620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.090656 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.090660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k695\" (UniqueName: \"kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.090898 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.090700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.091364 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.091332    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.093150 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.093093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.102133 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.102110    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k695\" (UniqueName: \"kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695\") pod \"maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.154936 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.154914    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:15.298036 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.298004    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:24:15.299558 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:24:15.299529    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5255079_fb0b_4b1e_80b9_2473e6e176a2.slice/crio-642e48e98939485f7acbbb13878474ebcdb37f718bc61571282bce246e60c6f1 WatchSource:0}: Error finding container 642e48e98939485f7acbbb13878474ebcdb37f718bc61571282bce246e60c6f1: Status 404 returned error can't find the container with id 642e48e98939485f7acbbb13878474ebcdb37f718bc61571282bce246e60c6f1
Jul 09 17:24:15.518145 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:15.518105    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" event={"ID":"f5255079-fb0b-4b1e-80b9-2473e6e176a2","Type":"ContainerStarted","Data":"642e48e98939485f7acbbb13878474ebcdb37f718bc61571282bce246e60c6f1"}
Jul 09 17:24:16.527226 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.527181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" event={"ID":"f5255079-fb0b-4b1e-80b9-2473e6e176a2","Type":"ContainerStarted","Data":"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"}
Jul 09 17:24:16.527644 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.527335    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:16.529644 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.529615    2570 generic.go:356] "Generic (PLEG): container finished" podID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerID="9531d492a4b0579ede225dfbbecc8fcd5ada6ffd377ee52781e658fd752086f1" exitCode=0
Jul 09 17:24:16.529774 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.529680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerDied","Data":"9531d492a4b0579ede225dfbbecc8fcd5ada6ffd377ee52781e658fd752086f1"}
Jul 09 17:24:16.529774 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.529728    2570 scope.go:117] "RemoveContainer" containerID="9e5cb97ec4242ebfd81702c02fcb4dab302e35a68c8e3ad94186d9bd6ec9f473"
Jul 09 17:24:16.545393 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.545223    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" podStartSLOduration=2.161606736 podStartE2EDuration="2.545205171s" totalImagesPullingTime="383.598435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:24:16.544660912 +0000 UTC m=+2015.878122026" watchObservedRunningTime="2026-07-09 17:24:16.545205171 +0000 UTC m=+2015.878666287"
Jul 09 17:24:16.604663 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.604598    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:24:16.707785 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.707750    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.707785 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.707789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.707850    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.707937    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.707972    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708044    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708068 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708065    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708098    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cd9r\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r\") pod \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\" (UID: \"7bb4d81f-852f-4a9b-912a-aedccae7a8ee\") "
Jul 09 17:24:16.708384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:16.708384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:16.708384 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708255    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:24:16.708591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708451    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.708591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708473    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.708591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708488    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.708591 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.708500    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:16.709158 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.709130    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:16.710285 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.710251    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:24:16.710388 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.710284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:24:16.710388 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.710324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:24:16.710494 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.710475    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r" (OuterVolumeSpecName: "kube-api-access-4cd9r") pod "7bb4d81f-852f-4a9b-912a-aedccae7a8ee" (UID: "7bb4d81f-852f-4a9b-912a-aedccae7a8ee"). InnerVolumeSpecName "kube-api-access-4cd9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:24:16.809217 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809185    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cd9r\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-kube-api-access-4cd9r\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.809217 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809212    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.809217 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809221    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.809428 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809229    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.809428 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809238    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:16.809428 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:16.809246    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb4d81f-852f-4a9b-912a-aedccae7a8ee-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:24:17.536902 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:17.536807    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"
Jul 09 17:24:17.536902 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:17.536854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4" event={"ID":"7bb4d81f-852f-4a9b-912a-aedccae7a8ee","Type":"ContainerDied","Data":"dfb30899d65179095fdbe8a914b98fa73284f37a3108ed382e42e0bfc837f53f"}
Jul 09 17:24:17.537379 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:17.536912    2570 scope.go:117] "RemoveContainer" containerID="9531d492a4b0579ede225dfbbecc8fcd5ada6ffd377ee52781e658fd752086f1"
Jul 09 17:24:17.557485 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:17.557456    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:24:17.563379 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:17.563358    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c494fe-openshift-default-9d9665c55-dh5p4"]
Jul 09 17:24:19.189311 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.189279    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" path="/var/lib/kubelet/pods/7bb4d81f-852f-4a9b-912a-aedccae7a8ee/volumes"
Jul 09 17:24:19.737904 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.737867    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:24:19.738430 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.738404    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:24:19.738430 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.738430    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:24:19.738618 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.738552    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:24:19.741854 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.741813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.744326 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.744304    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ba9b25-openshift-default-dockercfg-vtstj\""
Jul 09 17:24:19.753685 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.753663    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:24:19.835940 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.835892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836143 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.835948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836143 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836143 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836143 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qkf\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836371 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836371 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836371 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836279    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.836371 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.836322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937192 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937233    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937692 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qkf\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937692 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937802 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937897 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.937956 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.937890    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.938176 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.938136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.938243 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.938221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.940104 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.940077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.940250 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.940229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.945596 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.945573    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:19.945808 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:19.945790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qkf\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf\") pod \"e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") " pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:20.054681 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.054588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:20.191371 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.191345    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:24:20.192215 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:24:20.192189    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e9b7e1_cbd2_4aba_a2ec_9af915bdcd98.slice/crio-13023d4ece3b97e752ffc11eb0ebc55d497c0f16b1fbad324af6ca5c0847d59b WatchSource:0}: Error finding container 13023d4ece3b97e752ffc11eb0ebc55d497c0f16b1fbad324af6ca5c0847d59b: Status 404 returned error can't find the container with id 13023d4ece3b97e752ffc11eb0ebc55d497c0f16b1fbad324af6ca5c0847d59b
Jul 09 17:24:20.194693 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.194656    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:20.194796 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.194739    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:20.194796 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.194783    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:20.556448 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.556412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerStarted","Data":"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"}
Jul 09 17:24:20.556594 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.556465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerStarted","Data":"13023d4ece3b97e752ffc11eb0ebc55d497c0f16b1fbad324af6ca5c0847d59b"}
Jul 09 17:24:20.609170 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:20.609118    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podStartSLOduration=1.609101165 podStartE2EDuration="1.609101165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:24:20.606592741 +0000 UTC m=+2019.940053855" watchObservedRunningTime="2026-07-09 17:24:20.609101165 +0000 UTC m=+2019.942562279"
Jul 09 17:24:21.055459 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:21.055420    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:21.060687 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:21.060660    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:21.562353 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:21.562325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:21.563447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:21.563425    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:21.853193 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:21.853106    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:24:22.543304 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:22.543274    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:24:34.645782 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:34.645747    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:24:36.564417 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.564282    2570 patch_prober.go:28] interesting pod/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 09 17:24:36.564417 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.564342    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 09 17:24:36.658164 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.658133    2570 generic.go:356] "Generic (PLEG): container finished" podID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerID="37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c" exitCode=0
Jul 09 17:24:36.658364 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.658208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerDied","Data":"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"}
Jul 09 17:24:36.658674 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.658657    2570 scope.go:117] "RemoveContainer" containerID="37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"
Jul 09 17:24:36.659678 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.659652    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:36.659766 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.659733    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:36.659852 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:36.659804    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 09 17:24:37.666347 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:37.666310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerStarted","Data":"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"}
Jul 09 17:24:38.055240 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:38.055136    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:38.055394 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:38.055355    2570 patch_prober.go:28] interesting pod/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 09 17:24:38.055437 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:38.055413    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 09 17:24:39.055105 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:39.055063    2570 patch_prober.go:28] interesting pod/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 09 17:24:39.055515 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:39.055126    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 09 17:24:40.054965 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:40.054926    2570 patch_prober.go:28] interesting pod/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 09 17:24:40.055146 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:40.054991    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 09 17:24:41.055023 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:41.054984    2570 patch_prober.go:28] interesting pod/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 09 17:24:41.055228 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:41.055051    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 09 17:24:42.059016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:42.058981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:42.059461 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:42.059354    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:42.059981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:42.059963    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:24:44.547646 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:24:44.547605    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:25:14.052344 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:14.052307    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:25:31.442264 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:31.442232    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:25:41.272537 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:41.272505    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:25:41.276509 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:41.276483    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:25:41.277513 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:41.277493    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:25:41.281630 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:41.281612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:25:48.643962 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:25:48.643924    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:26:05.352175 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:26:05.352139    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:26:22.447761 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:26:22.447719    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:26:40.470983 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:26:40.470947    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:26:57.853974 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:26:57.853933    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:27:12.449535 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:12.449504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:27:28.913303 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.913267    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:27:28.913753 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.913671    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:27:28.913753 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.913683    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:27:28.913753 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.913747    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb4d81f-852f-4a9b-912a-aedccae7a8ee" containerName="istio-proxy"
Jul 09 17:27:28.916803 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.916785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:28.919415 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.919393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-553a9f\"/\"openshift-service-ca.crt\""
Jul 09 17:27:28.919530 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.919467    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-553a9f\"/\"kube-root-ca.crt\""
Jul 09 17:27:28.920724 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.920697    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-553a9f\"/\"sub-test-model-553a9f-kserve-self-signed-certs\""
Jul 09 17:27:28.920887 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.920871    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-553a9f\"/\"default-dockercfg-46p5h\""
Jul 09 17:27:28.928771 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.928742    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:27:28.988179 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:28.988143    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:27:29.013118 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013086    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsch\" (UniqueName: \"kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.013257 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.013257 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.013257 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013243    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.013361 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.013361 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.013290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.114640 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.114602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.114950 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.114924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115124 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115459 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whsch\" (UniqueName: \"kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115459 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115459 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115459 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115767 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.115822 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.115799    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.118538 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.118515    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.118941 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.118920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.127776 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.127752    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsch\" (UniqueName: \"kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch\") pod \"sub-test-model-553a9f-kserve-75f8cbc945-q2mmc\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") " pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.225582 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.225490    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:29.360294 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.360266    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:27:29.361913 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:27:29.361888    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10e7094a_cf1e_4745_8e3e_6f63da5d1ff7.slice/crio-ce2ed061b72e025e4c5511994197f3b5a9b0f8296f2bf967d86db14df39c6f85 WatchSource:0}: Error finding container ce2ed061b72e025e4c5511994197f3b5a9b0f8296f2bf967d86db14df39c6f85: Status 404 returned error can't find the container with id ce2ed061b72e025e4c5511994197f3b5a9b0f8296f2bf967d86db14df39c6f85
Jul 09 17:27:29.560398 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.560304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" event={"ID":"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7","Type":"ContainerStarted","Data":"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"}
Jul 09 17:27:29.560398 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.560345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" event={"ID":"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7","Type":"ContainerStarted","Data":"ce2ed061b72e025e4c5511994197f3b5a9b0f8296f2bf967d86db14df39c6f85"}
Jul 09 17:27:29.579547 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:29.579502    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" podStartSLOduration=1.5794879819999998 podStartE2EDuration="1.579487982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:27:29.577118776 +0000 UTC m=+2208.910579902" watchObservedRunningTime="2026-07-09 17:27:29.579487982 +0000 UTC m=+2208.912949155"
Jul 09 17:27:39.225855 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:39.225797    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:39.226246 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:39.225870    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:39.238391 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:39.238367    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:39.623958 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:39.623929    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:27:41.561158 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:41.561126    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:27:57.551327 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:27:57.551293    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:28:12.455404 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:12.455329    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:28:31.647067 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:31.647028    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:28:37.718069 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:37.718034    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:28:50.044881 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:50.044846    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:28:52.738854 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:52.738783    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" podUID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" containerName="main" containerID="cri-o://34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7" gracePeriod=45
Jul 09 17:28:52.993547 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:52.993488    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:28:53.003534 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.003505    2570 generic.go:356] "Generic (PLEG): container finished" podID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" containerID="34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7" exitCode=0
Jul 09 17:28:53.003705 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.003562    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"
Jul 09 17:28:53.003705 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.003601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" event={"ID":"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7","Type":"ContainerDied","Data":"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"}
Jul 09 17:28:53.003705 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.003643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc" event={"ID":"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7","Type":"ContainerDied","Data":"ce2ed061b72e025e4c5511994197f3b5a9b0f8296f2bf967d86db14df39c6f85"}
Jul 09 17:28:53.003705 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.003666    2570 scope.go:117] "RemoveContainer" containerID="34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"
Jul 09 17:28:53.012239 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.012222    2570 scope.go:117] "RemoveContainer" containerID="34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"
Jul 09 17:28:53.012530 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:28:53.012506    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7\": container with ID starting with 34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7 not found: ID does not exist" containerID="34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"
Jul 09 17:28:53.012623 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.012540    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7"} err="failed to get container status \"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7\": rpc error: code = NotFound desc = could not find container \"34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7\": container with ID starting with 34a46403e5f3f933f0f8405694f537f3eb6949345842090e4baa3faa7be13da7 not found: ID does not exist"
Jul 09 17:28:53.172981 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.172948    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173144 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173034    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173144 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173055    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173144 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173078    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whsch\" (UniqueName: \"kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173144 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173131    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173354 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173239    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache" (OuterVolumeSpecName: "model-cache") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:28:53.173354 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir\") pod \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\" (UID: \"10e7094a-cf1e-4745-8e3e-6f63da5d1ff7\") "
Jul 09 17:28:53.173465 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173361    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home" (OuterVolumeSpecName: "home") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:28:53.173544 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173513    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:28:53.173630 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173616    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-home\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.173682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173634    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tmp-dir\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.173682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.173645    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-model-cache\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.175418 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.175394    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm" (OuterVolumeSpecName: "dshm") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:28:53.175539 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.175429    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:28:53.175539 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.175428    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch" (OuterVolumeSpecName: "kube-api-access-whsch") pod "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" (UID: "10e7094a-cf1e-4745-8e3e-6f63da5d1ff7"). InnerVolumeSpecName "kube-api-access-whsch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:28:53.275037 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.274957    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-dshm\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.275037 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.274985    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-tls-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.275037 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.274995    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whsch\" (UniqueName: \"kubernetes.io/projected/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7-kube-api-access-whsch\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:28:53.319978 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.319948    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:28:53.324337 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:53.324311    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-553a9f/sub-test-model-553a9f-kserve-75f8cbc945-q2mmc"]
Jul 09 17:28:55.189719 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:28:55.189683    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" path="/var/lib/kubelet/pods/10e7094a-cf1e-4745-8e3e-6f63da5d1ff7/volumes"
Jul 09 17:29:24.542176 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:29:24.542135    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:29:46.955716 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:29:46.955679    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:30:05.546948 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:05.546910    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:30:12.180686 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.180648    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7162-140385806532144"]
Jul 09 17:30:12.181137 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.181028    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" containerName="main"
Jul 09 17:30:12.181137 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.181041    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" containerName="main"
Jul 09 17:30:12.181137 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.181113    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10e7094a-cf1e-4745-8e3e-6f63da5d1ff7" containerName="main"
Jul 09 17:30:12.183839 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.183811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:12.186370 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.186348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-7vdsn\""
Jul 09 17:30:12.188213 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.188150    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385806532144"]
Jul 09 17:30:12.270653 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.270620    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4x6g\" (UniqueName: \"kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g\") pod \"test-curl-7162-140385806532144\" (UID: \"22e89981-df64-4015-8aa0-12334e15fc26\") " pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:12.371544 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.371499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4x6g\" (UniqueName: \"kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g\") pod \"test-curl-7162-140385806532144\" (UID: \"22e89981-df64-4015-8aa0-12334e15fc26\") " pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:12.379569 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.379535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4x6g\" (UniqueName: \"kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g\") pod \"test-curl-7162-140385806532144\" (UID: \"22e89981-df64-4015-8aa0-12334e15fc26\") " pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:12.494709 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.494620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:12.627322 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.627294    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385806532144"]
Jul 09 17:30:12.629495 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:30:12.629471    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22e89981_df64_4015_8aa0_12334e15fc26.slice/crio-7e89e94f2c6319ed5c07ee9b5cd5bff868637dc149c3fab8e6c5882e93cd3fbb WatchSource:0}: Error finding container 7e89e94f2c6319ed5c07ee9b5cd5bff868637dc149c3fab8e6c5882e93cd3fbb: Status 404 returned error can't find the container with id 7e89e94f2c6319ed5c07ee9b5cd5bff868637dc149c3fab8e6c5882e93cd3fbb
Jul 09 17:30:12.631179 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:12.631160    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:30:13.439406 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:13.439379    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385806532144" event={"ID":"22e89981-df64-4015-8aa0-12334e15fc26","Type":"ContainerStarted","Data":"7e89e94f2c6319ed5c07ee9b5cd5bff868637dc149c3fab8e6c5882e93cd3fbb"}
Jul 09 17:30:14.446490 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:14.446451    2570 generic.go:356] "Generic (PLEG): container finished" podID="22e89981-df64-4015-8aa0-12334e15fc26" containerID="3ec99e4dd9971cd3ec46ddb03aabc312f307d98166436dd3aa4eff348b95b6bf" exitCode=0
Jul 09 17:30:14.446915 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:14.446541    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385806532144" event={"ID":"22e89981-df64-4015-8aa0-12334e15fc26","Type":"ContainerDied","Data":"3ec99e4dd9971cd3ec46ddb03aabc312f307d98166436dd3aa4eff348b95b6bf"}
Jul 09 17:30:15.596529 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.596497    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:15.631397 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.631365    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7162-140385806532144_22e89981-df64-4015-8aa0-12334e15fc26/test-curl-7162-140385806532144/0.log"
Jul 09 17:30:15.656234 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.656204    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7162-140385806532144"]
Jul 09 17:30:15.662882 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.662859    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7162-140385806532144"]
Jul 09 17:30:15.701733 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.701706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4x6g\" (UniqueName: \"kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g\") pod \"22e89981-df64-4015-8aa0-12334e15fc26\" (UID: \"22e89981-df64-4015-8aa0-12334e15fc26\") "
Jul 09 17:30:15.703996 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.703931    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g" (OuterVolumeSpecName: "kube-api-access-d4x6g") pod "22e89981-df64-4015-8aa0-12334e15fc26" (UID: "22e89981-df64-4015-8aa0-12334e15fc26"). InnerVolumeSpecName "kube-api-access-d4x6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:15.782508 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.782471    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7162-140385806529712"]
Jul 09 17:30:15.782853 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.782825    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e89981-df64-4015-8aa0-12334e15fc26" containerName="test-curl-7162-140385806532144"
Jul 09 17:30:15.782896 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.782854    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e89981-df64-4015-8aa0-12334e15fc26" containerName="test-curl-7162-140385806532144"
Jul 09 17:30:15.782952 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.782926    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e89981-df64-4015-8aa0-12334e15fc26" containerName="test-curl-7162-140385806532144"
Jul 09 17:30:15.786050 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.786033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:15.794499 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.794419    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385806529712"]
Jul 09 17:30:15.802419 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.802393    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4x6g\" (UniqueName: \"kubernetes.io/projected/22e89981-df64-4015-8aa0-12334e15fc26-kube-api-access-d4x6g\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:15.903102 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:15.903064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfg8r\" (UniqueName: \"kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r\") pod \"test-curl-7162-140385806529712\" (UID: \"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4\") " pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:16.004640 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.004542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfg8r\" (UniqueName: \"kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r\") pod \"test-curl-7162-140385806529712\" (UID: \"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4\") " pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:16.014292 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.014254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfg8r\" (UniqueName: \"kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r\") pod \"test-curl-7162-140385806529712\" (UID: \"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4\") " pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:16.100929 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.100890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:16.232991 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.232885    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385806529712"]
Jul 09 17:30:16.235544 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:30:16.235513    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8f14727_3a02_4a5c_b39b_4ce2dbb3eab4.slice/crio-fa7f5ca9a78953b5605c008e03af93b1b3a04a9b033eae369370b6b67dc3c8bd WatchSource:0}: Error finding container fa7f5ca9a78953b5605c008e03af93b1b3a04a9b033eae369370b6b67dc3c8bd: Status 404 returned error can't find the container with id fa7f5ca9a78953b5605c008e03af93b1b3a04a9b033eae369370b6b67dc3c8bd
Jul 09 17:30:16.458882 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.458849    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:16.459051 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.458862    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e89e94f2c6319ed5c07ee9b5cd5bff868637dc149c3fab8e6c5882e93cd3fbb"
Jul 09 17:30:16.460107 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:16.460076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385806529712" event={"ID":"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4","Type":"ContainerStarted","Data":"fa7f5ca9a78953b5605c008e03af93b1b3a04a9b033eae369370b6b67dc3c8bd"}
Jul 09 17:30:16.469219 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:30:16.469191    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7162-140385806532144\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="22e89981-df64-4015-8aa0-12334e15fc26" pod="openshift-ingress/test-curl-7162-140385806532144"
Jul 09 17:30:17.190063 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:17.190027    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22e89981-df64-4015-8aa0-12334e15fc26" path="/var/lib/kubelet/pods/22e89981-df64-4015-8aa0-12334e15fc26/volumes"
Jul 09 17:30:17.469502 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:17.469410    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" containerID="c1cca0724ec6907d17be8cdb570343a24768c25d0c71826b3a3d496a5e31d78e" exitCode=0
Jul 09 17:30:17.469502 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:17.469439    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385806529712" event={"ID":"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4","Type":"ContainerDied","Data":"c1cca0724ec6907d17be8cdb570343a24768c25d0c71826b3a3d496a5e31d78e"}
Jul 09 17:30:18.617245 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.617219    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:18.637287 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.637266    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7162-140385806529712_c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4/test-curl-7162-140385806529712/0.log"
Jul 09 17:30:18.660397 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.660367    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7162-140385806529712"]
Jul 09 17:30:18.664734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.664707    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7162-140385806529712"]
Jul 09 17:30:18.729781 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.729711    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfg8r\" (UniqueName: \"kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r\") pod \"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4\" (UID: \"c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4\") "
Jul 09 17:30:18.731735 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.731707    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r" (OuterVolumeSpecName: "kube-api-access-kfg8r") pod "c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" (UID: "c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4"). InnerVolumeSpecName "kube-api-access-kfg8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:18.831224 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.831190    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfg8r\" (UniqueName: \"kubernetes.io/projected/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4-kube-api-access-kfg8r\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:18.851035 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.851003    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:18.851377 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.851364    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" containerName="test-curl-7162-140385806529712"
Jul 09 17:30:18.851434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.851379    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" containerName="test-curl-7162-140385806529712"
Jul 09 17:30:18.851434 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.851432    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" containerName="test-curl-7162-140385806529712"
Jul 09 17:30:18.854675 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.854658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:18.874458 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.874434    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:18.931691 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:18.931643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkm2\" (UniqueName: \"kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2\") pod \"test-curl-7162-140385809311616\" (UID: \"1a1b107e-d256-4e14-abde-f2c47ce26ea9\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:19.033071 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.032982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkm2\" (UniqueName: \"kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2\") pod \"test-curl-7162-140385809311616\" (UID: \"1a1b107e-d256-4e14-abde-f2c47ce26ea9\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:19.041016 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.040990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkm2\" (UniqueName: \"kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2\") pod \"test-curl-7162-140385809311616\" (UID: \"1a1b107e-d256-4e14-abde-f2c47ce26ea9\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:19.163110 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.163074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:19.189332 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.189298    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4" path="/var/lib/kubelet/pods/c8f14727-3a02-4a5c-b39b-4ce2dbb3eab4/volumes"
Jul 09 17:30:19.295403 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.295375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:19.296810 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:30:19.296782    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a1b107e_d256_4e14_abde_f2c47ce26ea9.slice/crio-a5c78e74c02a0843b544e714ede9bdc55382788f6ef4a0097e81dcf10c1de3db WatchSource:0}: Error finding container a5c78e74c02a0843b544e714ede9bdc55382788f6ef4a0097e81dcf10c1de3db: Status 404 returned error can't find the container with id a5c78e74c02a0843b544e714ede9bdc55382788f6ef4a0097e81dcf10c1de3db
Jul 09 17:30:19.481734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.481705    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385806529712"
Jul 09 17:30:19.481734 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.481732    2570 scope.go:117] "RemoveContainer" containerID="c1cca0724ec6907d17be8cdb570343a24768c25d0c71826b3a3d496a5e31d78e"
Jul 09 17:30:19.483078 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:19.483052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809311616" event={"ID":"1a1b107e-d256-4e14-abde-f2c47ce26ea9","Type":"ContainerStarted","Data":"a5c78e74c02a0843b544e714ede9bdc55382788f6ef4a0097e81dcf10c1de3db"}
Jul 09 17:30:20.490684 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:20.490650    2570 generic.go:356] "Generic (PLEG): container finished" podID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" containerID="b50caab0cb28d655d96f8a9622a490ee22097bbaa9ea7ac595f1b9c8b2217b5f" exitCode=0
Jul 09 17:30:20.491063 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:20.490730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809311616" event={"ID":"1a1b107e-d256-4e14-abde-f2c47ce26ea9","Type":"ContainerDied","Data":"b50caab0cb28d655d96f8a9622a490ee22097bbaa9ea7ac595f1b9c8b2217b5f"}
Jul 09 17:30:21.637100 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.637073    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:21.657378 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.657355    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7162-140385809311616_1a1b107e-d256-4e14-abde-f2c47ce26ea9/test-curl-7162-140385809311616/0.log"
Jul 09 17:30:21.681208 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.681178    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:21.684585 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.684560    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:21.758368 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.758292    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfkm2\" (UniqueName: \"kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2\") pod \"1a1b107e-d256-4e14-abde-f2c47ce26ea9\" (UID: \"1a1b107e-d256-4e14-abde-f2c47ce26ea9\") "
Jul 09 17:30:21.760431 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.760380    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2" (OuterVolumeSpecName: "kube-api-access-nfkm2") pod "1a1b107e-d256-4e14-abde-f2c47ce26ea9" (UID: "1a1b107e-d256-4e14-abde-f2c47ce26ea9"). InnerVolumeSpecName "kube-api-access-nfkm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:21.815939 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.815906    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:21.816327 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.816307    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:21.816327 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.816324    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:21.816520 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.816383    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:21.819549 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.819520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:21.826206 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.826183    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:21.859556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.859529    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfkm2\" (UniqueName: \"kubernetes.io/projected/1a1b107e-d256-4e14-abde-f2c47ce26ea9-kube-api-access-nfkm2\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:21.960377 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:21.960340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtsb\" (UniqueName: \"kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb\") pod \"test-curl-7162-140385809311616\" (UID: \"b25db76f-57a7-48cf-ac9c-0e4f11e7711d\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:22.061214 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.061119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtsb\" (UniqueName: \"kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb\") pod \"test-curl-7162-140385809311616\" (UID: \"b25db76f-57a7-48cf-ac9c-0e4f11e7711d\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:22.068913 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.068887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtsb\" (UniqueName: \"kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb\") pod \"test-curl-7162-140385809311616\" (UID: \"b25db76f-57a7-48cf-ac9c-0e4f11e7711d\") " pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:22.130627 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.130601    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:22.262607 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.262581    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:22.264254 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:30:22.264229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25db76f_57a7_48cf_ac9c_0e4f11e7711d.slice/crio-11ecdfa2a02280bf458a7590b7d24616653e08fe5c19cd40a01fe71ecfbddbd6 WatchSource:0}: Error finding container 11ecdfa2a02280bf458a7590b7d24616653e08fe5c19cd40a01fe71ecfbddbd6: Status 404 returned error can't find the container with id 11ecdfa2a02280bf458a7590b7d24616653e08fe5c19cd40a01fe71ecfbddbd6
Jul 09 17:30:22.504091 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.504055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809311616" event={"ID":"b25db76f-57a7-48cf-ac9c-0e4f11e7711d","Type":"ContainerStarted","Data":"11ecdfa2a02280bf458a7590b7d24616653e08fe5c19cd40a01fe71ecfbddbd6"}
Jul 09 17:30:22.505314 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.505291    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:22.505443 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.505319    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5c78e74c02a0843b544e714ede9bdc55382788f6ef4a0097e81dcf10c1de3db"
Jul 09 17:30:22.517220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.517185    2570 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7162-140385809311616" oldPodUID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" podUID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d"
Jul 09 17:30:22.649967 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:22.649941    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:30:23.189625 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:23.189590    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a1b107e-d256-4e14-abde-f2c47ce26ea9" path="/var/lib/kubelet/pods/1a1b107e-d256-4e14-abde-f2c47ce26ea9/volumes"
Jul 09 17:30:23.512311 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:23.512213    2570 generic.go:356] "Generic (PLEG): container finished" podID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d" containerID="676da6be014dfbc0600814f9010da1350e0ab5b574356e11d8346c9dc19c773f" exitCode=0
Jul 09 17:30:23.512311 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:23.512259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809311616" event={"ID":"b25db76f-57a7-48cf-ac9c-0e4f11e7711d","Type":"ContainerDied","Data":"676da6be014dfbc0600814f9010da1350e0ab5b574356e11d8346c9dc19c773f"}
Jul 09 17:30:24.659801 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.659779    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:24.679485 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.679448    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7162-140385809311616_b25db76f-57a7-48cf-ac9c-0e4f11e7711d/test-curl-7162-140385809311616/0.log"
Jul 09 17:30:24.701843 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.701800    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:24.707978 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.707932    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7162-140385809311616"]
Jul 09 17:30:24.787377 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.787294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjtsb\" (UniqueName: \"kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb\") pod \"b25db76f-57a7-48cf-ac9c-0e4f11e7711d\" (UID: \"b25db76f-57a7-48cf-ac9c-0e4f11e7711d\") "
Jul 09 17:30:24.789463 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.789435    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb" (OuterVolumeSpecName: "kube-api-access-vjtsb") pod "b25db76f-57a7-48cf-ac9c-0e4f11e7711d" (UID: "b25db76f-57a7-48cf-ac9c-0e4f11e7711d"). InnerVolumeSpecName "kube-api-access-vjtsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:24.837723 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.837686    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7162-140385809312624"]
Jul 09 17:30:24.838098 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.838085    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:24.838151 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.838099    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:24.838184 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.838161    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d" containerName="test-curl-7162-140385809311616"
Jul 09 17:30:24.841076 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.841059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:24.844511 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.844487    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809312624"]
Jul 09 17:30:24.888411 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.888383    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjtsb\" (UniqueName: \"kubernetes.io/projected/b25db76f-57a7-48cf-ac9c-0e4f11e7711d-kube-api-access-vjtsb\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:24.988958 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:24.988922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxfk\" (UniqueName: \"kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk\") pod \"test-curl-7162-140385809312624\" (UID: \"0555c6e3-87c8-467c-aaeb-5d5893a5dec5\") " pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:25.089682 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.089586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxfk\" (UniqueName: \"kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk\") pod \"test-curl-7162-140385809312624\" (UID: \"0555c6e3-87c8-467c-aaeb-5d5893a5dec5\") " pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:25.098570 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.098536    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxfk\" (UniqueName: \"kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk\") pod \"test-curl-7162-140385809312624\" (UID: \"0555c6e3-87c8-467c-aaeb-5d5893a5dec5\") " pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:25.151660 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.151623    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:25.190069 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.190040    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25db76f-57a7-48cf-ac9c-0e4f11e7711d" path="/var/lib/kubelet/pods/b25db76f-57a7-48cf-ac9c-0e4f11e7711d/volumes"
Jul 09 17:30:25.286207 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.286176    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7162-140385809312624"]
Jul 09 17:30:25.287645 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:30:25.287620    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0555c6e3_87c8_467c_aaeb_5d5893a5dec5.slice/crio-e162b746ac459922fc29844663b844afc820dd7cafeea2fd9b87755172ebfbcc WatchSource:0}: Error finding container e162b746ac459922fc29844663b844afc820dd7cafeea2fd9b87755172ebfbcc: Status 404 returned error can't find the container with id e162b746ac459922fc29844663b844afc820dd7cafeea2fd9b87755172ebfbcc
Jul 09 17:30:25.524049 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.524012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809312624" event={"ID":"0555c6e3-87c8-467c-aaeb-5d5893a5dec5","Type":"ContainerStarted","Data":"e162b746ac459922fc29844663b844afc820dd7cafeea2fd9b87755172ebfbcc"}
Jul 09 17:30:25.525318 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.525298    2570 scope.go:117] "RemoveContainer" containerID="676da6be014dfbc0600814f9010da1350e0ab5b574356e11d8346c9dc19c773f"
Jul 09 17:30:25.525461 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:25.525338    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809311616"
Jul 09 17:30:26.534656 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:26.534619    2570 generic.go:356] "Generic (PLEG): container finished" podID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" containerID="668a52ab86c3436bd750b53392fcb0fb16428481b008dbfcf44c0363a2b2fe80" exitCode=0
Jul 09 17:30:26.535073 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:26.534702    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7162-140385809312624" event={"ID":"0555c6e3-87c8-467c-aaeb-5d5893a5dec5","Type":"ContainerDied","Data":"668a52ab86c3436bd750b53392fcb0fb16428481b008dbfcf44c0363a2b2fe80"}
Jul 09 17:30:27.695033 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.695006    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:27.715290 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.715248    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7162-140385809312624_0555c6e3-87c8-467c-aaeb-5d5893a5dec5/test-curl-7162-140385809312624/0.log"
Jul 09 17:30:27.740236 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.740205    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7162-140385809312624"]
Jul 09 17:30:27.742330 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.742308    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7162-140385809312624"]
Jul 09 17:30:27.817444 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.817353    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpxfk\" (UniqueName: \"kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk\") pod \"0555c6e3-87c8-467c-aaeb-5d5893a5dec5\" (UID: \"0555c6e3-87c8-467c-aaeb-5d5893a5dec5\") "
Jul 09 17:30:27.819471 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.819442    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk" (OuterVolumeSpecName: "kube-api-access-qpxfk") pod "0555c6e3-87c8-467c-aaeb-5d5893a5dec5" (UID: "0555c6e3-87c8-467c-aaeb-5d5893a5dec5"). InnerVolumeSpecName "kube-api-access-qpxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:27.918151 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:27.918110    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpxfk\" (UniqueName: \"kubernetes.io/projected/0555c6e3-87c8-467c-aaeb-5d5893a5dec5-kube-api-access-qpxfk\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:28.550946 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:28.550915    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:28.551123 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:28.550959    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e162b746ac459922fc29844663b844afc820dd7cafeea2fd9b87755172ebfbcc"
Jul 09 17:30:28.561137 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:30:28.561107    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7162-140385809312624\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" pod="openshift-ingress/test-curl-7162-140385809312624"
Jul 09 17:30:29.189368 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:29.189332    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" path="/var/lib/kubelet/pods/0555c6e3-87c8-467c-aaeb-5d5893a5dec5/volumes"
Jul 09 17:30:31.992409 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:31.992376    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:30:31.992878 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:31.992627    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" podUID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" containerName="maas-api" containerID="cri-o://d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172" gracePeriod=30
Jul 09 17:30:32.246593 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.246529    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:30:32.249597 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.249578    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls\") pod \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") "
Jul 09 17:30:32.249701 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.249629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca\") pod \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") "
Jul 09 17:30:32.249701 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.249657    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k695\" (UniqueName: \"kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695\") pod \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\" (UID: \"f5255079-fb0b-4b1e-80b9-2473e6e176a2\") "
Jul 09 17:30:32.250097 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.250068    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5255079-fb0b-4b1e-80b9-2473e6e176a2" (UID: "f5255079-fb0b-4b1e-80b9-2473e6e176a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:30:32.251695 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.251666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5255079-fb0b-4b1e-80b9-2473e6e176a2" (UID: "f5255079-fb0b-4b1e-80b9-2473e6e176a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:30:32.251773 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.251718    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695" (OuterVolumeSpecName: "kube-api-access-7k695") pod "f5255079-fb0b-4b1e-80b9-2473e6e176a2" (UID: "f5255079-fb0b-4b1e-80b9-2473e6e176a2"). InnerVolumeSpecName "kube-api-access-7k695". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:32.350344 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.350315    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5255079-fb0b-4b1e-80b9-2473e6e176a2-maas-api-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:32.350344 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.350340    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5255079-fb0b-4b1e-80b9-2473e6e176a2-openshift-service-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:32.350344 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.350350    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k695\" (UniqueName: \"kubernetes.io/projected/f5255079-fb0b-4b1e-80b9-2473e6e176a2-kube-api-access-7k695\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:32.574272 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.574171    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" containerID="d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172" exitCode=0
Jul 09 17:30:32.574272 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.574218    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"
Jul 09 17:30:32.574272 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.574259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" event={"ID":"f5255079-fb0b-4b1e-80b9-2473e6e176a2","Type":"ContainerDied","Data":"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"}
Jul 09 17:30:32.574554 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.574317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9" event={"ID":"f5255079-fb0b-4b1e-80b9-2473e6e176a2","Type":"ContainerDied","Data":"642e48e98939485f7acbbb13878474ebcdb37f718bc61571282bce246e60c6f1"}
Jul 09 17:30:32.574554 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.574345    2570 scope.go:117] "RemoveContainer" containerID="d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"
Jul 09 17:30:32.583555 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.583533    2570 scope.go:117] "RemoveContainer" containerID="d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"
Jul 09 17:30:32.583809 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:30:32.583786    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172\": container with ID starting with d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172 not found: ID does not exist" containerID="d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"
Jul 09 17:30:32.583901 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.583816    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172"} err="failed to get container status \"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172\": rpc error: code = NotFound desc = could not find container \"d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172\": container with ID starting with d701477fafbfe19ef356c2923626ae9b5b9ad400c9ad5c5ed3431c8f9db5a172 not found: ID does not exist"
Jul 09 17:30:32.596609 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.596582    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:30:32.600052 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:32.600028    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-553a9f-7cbd796656-cj4k9"]
Jul 09 17:30:33.189748 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:33.189716    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" path="/var/lib/kubelet/pods/f5255079-fb0b-4b1e-80b9-2473e6e176a2/volumes"
Jul 09 17:30:35.651292 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:35.651255    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:30:41.311991 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:41.311965    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:30:41.317256 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:41.317231    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:30:41.317776 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:41.317754    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:30:41.321962 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:41.321941    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:30:45.189862 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:45.189815    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:30:45.190275 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:45.190081    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy" containerID="cri-o://e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291" gracePeriod=30
Jul 09 17:30:47.553312 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:47.553276    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fkp2t"]
Jul 09 17:30:50.449261 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.449234    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:30:50.498640 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.498640 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.498886 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498652    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.498886 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498698    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72qkf\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.498886 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.498886 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498863    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.499114 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498904    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.499114 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498930    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.499114 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.498975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs\") pod \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\" (UID: \"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98\") "
Jul 09 17:30:50.499114 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499047    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:50.499114 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499104    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:30:50.499385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499267    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:50.499385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:50.499385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499316    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-credential-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.499385 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499337    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istiod-ca-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.499903 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.499880    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data" (OuterVolumeSpecName: "istio-data") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:50.500884 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.500861    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token" (OuterVolumeSpecName: "istio-token") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:50.501060 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.501042    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf" (OuterVolumeSpecName: "kube-api-access-72qkf") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "kube-api-access-72qkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:30:50.501287 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.501265    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:30:50.501361 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.501340    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" (UID: "89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 17:30:50.600345 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600305    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72qkf\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-kube-api-access-72qkf\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600345 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600344    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-podinfo\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600359    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-socket\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600377    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-data\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600392    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-workload-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600404    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-envoy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.600556 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.600416    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98-istio-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\""
Jul 09 17:30:50.677510 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.677473    2570 generic.go:356] "Generic (PLEG): container finished" podID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerID="e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291" exitCode=0
Jul 09 17:30:50.677683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.677522    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"
Jul 09 17:30:50.677683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.677560    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerDied","Data":"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"}
Jul 09 17:30:50.677683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.677613    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq" event={"ID":"89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98","Type":"ContainerDied","Data":"13023d4ece3b97e752ffc11eb0ebc55d497c0f16b1fbad324af6ca5c0847d59b"}
Jul 09 17:30:50.677683 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.677636    2570 scope.go:117] "RemoveContainer" containerID="e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"
Jul 09 17:30:50.687003 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.686988    2570 scope.go:117] "RemoveContainer" containerID="37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"
Jul 09 17:30:50.695266 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.695243    2570 scope.go:117] "RemoveContainer" containerID="e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"
Jul 09 17:30:50.695542 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:30:50.695521    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291\": container with ID starting with e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291 not found: ID does not exist" containerID="e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"
Jul 09 17:30:50.695606 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.695551    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291"} err="failed to get container status \"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291\": rpc error: code = NotFound desc = could not find container \"e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291\": container with ID starting with e9e9bfa99a34eaed80786a24ddbfa5c00f3cde8877f1695f0a40372434cac291 not found: ID does not exist"
Jul 09 17:30:50.695606 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.695571    2570 scope.go:117] "RemoveContainer" containerID="37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"
Jul 09 17:30:50.695898 ip-10-0-135-121 kubenswrapper[2570]: E0709 17:30:50.695818    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c\": container with ID starting with 37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c not found: ID does not exist" containerID="37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"
Jul 09 17:30:50.695898 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.695861    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c"} err="failed to get container status \"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c\": rpc error: code = NotFound desc = could not find container \"37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c\": container with ID starting with 37bb0a6c5bfdd5ff2a7f35ae57e34aaa5d4d40bfade3d25e78f0f064d821db6c not found: ID does not exist"
Jul 09 17:30:50.700240 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.700217    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:30:50.703278 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.703256    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ba9b25-openshift-default-596b7495-x9bjq"]
Jul 09 17:30:50.879379 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:50.879354    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kb7gr_1ace2155-3702-47c7-b89f-9f9e7a642b8c/server/0.log"
Jul 09 17:30:51.193094 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:51.191062    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" path="/var/lib/kubelet/pods/89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98/volumes"
Jul 09 17:30:51.356400 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:51.356371    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-wh2xw_03be99aa-424c-4ced-8cc6-c21d58081fd9/copy-manifests/0.log"
Jul 09 17:30:51.363187 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:51.363159    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-wh2xw_03be99aa-424c-4ced-8cc6-c21d58081fd9/manager/0.log"
Jul 09 17:30:52.895021 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:52.894983    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/extract/0.log"
Jul 09 17:30:52.900749 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:52.900722    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/util/0.log"
Jul 09 17:30:52.907176 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:52.907150    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/pull/0.log"
Jul 09 17:30:53.010889 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.010855    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/pull/0.log"
Jul 09 17:30:53.016587 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.016561    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/extract/0.log"
Jul 09 17:30:53.021730 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.021708    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/util/0.log"
Jul 09 17:30:53.132622 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.132583    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/util/0.log"
Jul 09 17:30:53.139281 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.139258    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/pull/0.log"
Jul 09 17:30:53.146074 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.146011    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/extract/0.log"
Jul 09 17:30:53.248957 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.248927    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/util/0.log"
Jul 09 17:30:53.255165 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.255145    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/pull/0.log"
Jul 09 17:30:53.260674 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.260654    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/extract/0.log"
Jul 09 17:30:53.502715 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.502629    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j27rz_7287f5e2-ecca-4582-ab7e-61ac8a8d44b9/manager/0.log"
Jul 09 17:30:53.971012 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:53.970981    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qkptc_6028569a-c36d-4536-8698-fef395307412/manager/0.log"
Jul 09 17:30:54.095893 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:54.095860    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fkp2t_eb29f4a2-9ef2-487a-886a-5999845357d6/limitador/0.log"
Jul 09 17:30:54.553517 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:54.553485    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44xsgk_5bd24181-3ca7-4e5e-89e7-52e750900ae2/istio-proxy/0.log"
Jul 09 17:30:54.678096 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:54.678039    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bzg67_4aebbefd-97a9-4aca-a7a0-dde059d933e2/discovery/0.log"
Jul 09 17:30:54.787184 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:54.787154    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b94bd4c99-6267q_7ea05c53-790d-45a5-83f9-8b4d52f0ba87/kube-auth-proxy/0.log"
Jul 09 17:30:55.369793 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:55.369762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-656b79498-fhh6t_4c35b51d-1e89-414c-aabb-e207e27e4af6/router/0.log"
Jul 09 17:30:56.023718 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:56.023688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6g7xs_538df19d-ee4a-43f1-b372-53c904be734d/main/0.log"
Jul 09 17:30:59.745003 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.744968    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l7jhs/must-gather-5q4xb"]
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745356    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745374    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745387    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" containerName="test-curl-7162-140385809312624"
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745394    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" containerName="test-curl-7162-140385809312624"
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745415    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" containerName="maas-api"
Jul 09 17:30:59.745433 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745424    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" containerName="maas-api"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745522    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5255079-fb0b-4b1e-80b9-2473e6e176a2" containerName="maas-api"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745537    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745549    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0555c6e3-87c8-467c-aaeb-5d5893a5dec5" containerName="test-curl-7162-140385809312624"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745620    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745626    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.745825 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.745690    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e9b7e1-cbd2-4aba-a2ec-9af915bdcd98" containerName="istio-proxy"
Jul 09 17:30:59.750582 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.750560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.753218 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.753200    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7jhs\"/\"openshift-service-ca.crt\""
Jul 09 17:30:59.754295 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.754273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l7jhs\"/\"default-dockercfg-nkppl\""
Jul 09 17:30:59.754379 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.754282    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7jhs\"/\"kube-root-ca.crt\""
Jul 09 17:30:59.758781 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.758760    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/must-gather-5q4xb"]
Jul 09 17:30:59.883447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.883415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v579w\" (UniqueName: \"kubernetes.io/projected/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-kube-api-access-v579w\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.883611 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.883477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-must-gather-output\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.984627 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.984591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-must-gather-output\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.984809 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.984649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v579w\" (UniqueName: \"kubernetes.io/projected/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-kube-api-access-v579w\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.985040 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.985018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-must-gather-output\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:30:59.993886 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:30:59.993860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v579w\" (UniqueName: \"kubernetes.io/projected/65d9bbf6-c4fd-476f-9d25-06ca00c5ac15-kube-api-access-v579w\") pod \"must-gather-5q4xb\" (UID: \"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15\") " pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:31:00.060718 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:00.060635    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/must-gather-5q4xb"
Jul 09 17:31:00.192892 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:00.192868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/must-gather-5q4xb"]
Jul 09 17:31:00.195647 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:31:00.195612    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65d9bbf6_c4fd_476f_9d25_06ca00c5ac15.slice/crio-c6da3b7f1eb4ab3a3ab8e2eac68a04067f014d8242dab8673fabc480d5c4737b WatchSource:0}: Error finding container c6da3b7f1eb4ab3a3ab8e2eac68a04067f014d8242dab8673fabc480d5c4737b: Status 404 returned error can't find the container with id c6da3b7f1eb4ab3a3ab8e2eac68a04067f014d8242dab8673fabc480d5c4737b
Jul 09 17:31:00.732209 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:00.732170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/must-gather-5q4xb" event={"ID":"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15","Type":"ContainerStarted","Data":"c6da3b7f1eb4ab3a3ab8e2eac68a04067f014d8242dab8673fabc480d5c4737b"}
Jul 09 17:31:01.740361 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:01.740321    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/must-gather-5q4xb" event={"ID":"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15","Type":"ContainerStarted","Data":"e04990c7a9478a836fcd17fdf4eaab6ffc3d61fd58bfa9d00f3fa33d0debb7e6"}
Jul 09 17:31:01.740794 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:01.740370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/must-gather-5q4xb" event={"ID":"65d9bbf6-c4fd-476f-9d25-06ca00c5ac15","Type":"ContainerStarted","Data":"59b4c045354c0e41f2e1190e62329d3e091bdd95b040918c9ff2fe3bfb36954e"}
Jul 09 17:31:01.759478 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:01.759417    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l7jhs/must-gather-5q4xb" podStartSLOduration=1.968912682 podStartE2EDuration="2.759401629s" totalImagesPullingTime="790.488947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:01.75616635 +0000 UTC m=+2421.089627466" watchObservedRunningTime="2026-07-09 17:31:01.759401629 +0000 UTC m=+2421.092862743"
Jul 09 17:31:02.617197 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:02.617161    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tn6kw_205d0beb-7cf0-4dc6-b0a3-854be0c73afa/global-pull-secret-syncer/0.log"
Jul 09 17:31:02.740523 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:02.740478    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wzhlk_45977ed8-0d0c-4b0b-b024-ceeceb147241/konnectivity-agent/0.log"
Jul 09 17:31:02.766802 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:02.766758    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-121.ec2.internal_e0f19aeb089e708583fd55e8921a86f8/haproxy/0.log"
Jul 09 17:31:07.407338 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.407305    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/extract/0.log"
Jul 09 17:31:07.435550 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.435468    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/util/0.log"
Jul 09 17:31:07.457792 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.457756    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759x4rsw_954a8a99-cc4a-40d2-a8b2-1dd2a0cd96cd/pull/0.log"
Jul 09 17:31:07.484671 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.484640    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/extract/0.log"
Jul 09 17:31:07.506038 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.506009    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/util/0.log"
Jul 09 17:31:07.528727 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.528701    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf8ql_3f897493-60db-45b1-a28e-a0a8e6884881/pull/0.log"
Jul 09 17:31:07.573617 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.573591    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/extract/0.log"
Jul 09 17:31:07.597211 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.597179    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/util/0.log"
Jul 09 17:31:07.627002 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.626953    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cs9fl_e8312d9e-b010-4f63-b579-aae04e2b886f/pull/0.log"
Jul 09 17:31:07.654017 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.653986    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/extract/0.log"
Jul 09 17:31:07.674447 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.674366    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/util/0.log"
Jul 09 17:31:07.694860 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.694816    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lrpth_3f2b7a3e-4469-4f3a-8e62-7eb37fcef037/pull/0.log"
Jul 09 17:31:07.989735 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:07.989655    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j27rz_7287f5e2-ecca-4582-ab7e-61ac8a8d44b9/manager/0.log"
Jul 09 17:31:08.302900 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:08.299287    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qkptc_6028569a-c36d-4536-8698-fef395307412/manager/0.log"
Jul 09 17:31:08.340997 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:08.340968    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fkp2t_eb29f4a2-9ef2-487a-886a-5999845357d6/limitador/0.log"
Jul 09 17:31:10.260535 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:10.260447    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/1.log"
Jul 09 17:31:10.417584 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:10.416685    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wd84b_eb3fc3ea-0f26-42b2-8e85-30666d3ab281/cluster-monitoring-operator/0.log"
Jul 09 17:31:10.662654 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:10.662622    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qb59b_e60fd2df-9919-43e4-94d2-918a33478b42/node-exporter/0.log"
Jul 09 17:31:10.687012 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:10.686981    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qb59b_e60fd2df-9919-43e4-94d2-918a33478b42/kube-rbac-proxy/0.log"
Jul 09 17:31:10.714922 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:10.714890    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qb59b_e60fd2df-9919-43e4-94d2-918a33478b42/init-textfile/0.log"
Jul 09 17:31:12.357748 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.357702    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"]
Jul 09 17:31:12.364790 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.364750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.371287 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.371257    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"]
Jul 09 17:31:12.512809 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.512752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-proc\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.512995 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.512818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-sys\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.512995 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.512975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-lib-modules\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.513084 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.513050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-podres\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.513120 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.513098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zld5x\" (UniqueName: \"kubernetes.io/projected/052a2c0e-d8ef-49da-bc12-ab019d8c325d-kube-api-access-zld5x\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.614345 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.614260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-proc\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.614629 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.614406    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-proc\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.614802 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.614776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-sys\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.614902 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.614572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-sys\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.615081 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.615064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-lib-modules\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.615339 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.615324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-podres\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.615548 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.615534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zld5x\" (UniqueName: \"kubernetes.io/projected/052a2c0e-d8ef-49da-bc12-ab019d8c325d-kube-api-access-zld5x\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.616065 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.615273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-lib-modules\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.616201 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.615488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/052a2c0e-d8ef-49da-bc12-ab019d8c325d-podres\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.626406 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.626378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zld5x\" (UniqueName: \"kubernetes.io/projected/052a2c0e-d8ef-49da-bc12-ab019d8c325d-kube-api-access-zld5x\") pod \"perf-node-gather-daemonset-j7n6g\" (UID: \"052a2c0e-d8ef-49da-bc12-ab019d8c325d\") " pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.681853 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.681799    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:12.689306 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.689277    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-8xmtd_72e7e3d9-e930-4b7a-8ab0-3213a2179bbc/networking-console-plugin/0.log"
Jul 09 17:31:12.900918 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:12.900891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"]
Jul 09 17:31:12.903053 ip-10-0-135-121 kubenswrapper[2570]: W0709 17:31:12.903021    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod052a2c0e_d8ef_49da_bc12_ab019d8c325d.slice/crio-b82e021cb79c01d9af18769a2c6b25ba1d7beada1bede61d754edd3e71a0b322 WatchSource:0}: Error finding container b82e021cb79c01d9af18769a2c6b25ba1d7beada1bede61d754edd3e71a0b322: Status 404 returned error can't find the container with id b82e021cb79c01d9af18769a2c6b25ba1d7beada1bede61d754edd3e71a0b322
Jul 09 17:31:13.347152 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.347054    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/1.log"
Jul 09 17:31:13.356246 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.356212    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mrvdr_5147479c-6df1-4a9f-83c2-563a015f1670/console-operator/2.log"
Jul 09 17:31:13.841231 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.841190    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g" event={"ID":"052a2c0e-d8ef-49da-bc12-ab019d8c325d","Type":"ContainerStarted","Data":"efab21e5957316514b75cfe2633fa24f3464118d821d75ca10915b02f805dcca"}
Jul 09 17:31:13.841649 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.841312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g" event={"ID":"052a2c0e-d8ef-49da-bc12-ab019d8c325d","Type":"ContainerStarted","Data":"b82e021cb79c01d9af18769a2c6b25ba1d7beada1bede61d754edd3e71a0b322"}
Jul 09 17:31:13.841649 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.841346    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:13.860476 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:13.860427    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g" podStartSLOduration=1.860410855 podStartE2EDuration="1.860410855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:13.859029719 +0000 UTC m=+2433.192490860" watchObservedRunningTime="2026-07-09 17:31:13.860410855 +0000 UTC m=+2433.193871968"
Jul 09 17:31:14.471662 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:14.471629    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-qk8bw_d23d8333-5014-4699-806d-2807fec43376/volume-data-source-validator/0.log"
Jul 09 17:31:15.463069 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:15.463036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nlhj_f1403ef1-99fe-4e7f-8193-45884c314367/dns/0.log"
Jul 09 17:31:15.481220 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:15.481187    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nlhj_f1403ef1-99fe-4e7f-8193-45884c314367/kube-rbac-proxy/0.log"
Jul 09 17:31:15.615746 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:15.615718    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vll5_465f24b0-84be-4cc7-822b-313c33b37a3f/dns-node-resolver/0.log"
Jul 09 17:31:16.227987 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:16.227958    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-td7lj_a6998544-d4eb-4286-9185-92be919467de/node-ca/0.log"
Jul 09 17:31:17.172521 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:17.172489    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44xsgk_5bd24181-3ca7-4e5e-89e7-52e750900ae2/istio-proxy/0.log"
Jul 09 17:31:17.374112 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:17.374081    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bzg67_4aebbefd-97a9-4aca-a7a0-dde059d933e2/discovery/0.log"
Jul 09 17:31:17.394424 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:17.394398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b94bd4c99-6267q_7ea05c53-790d-45a5-83f9-8b4d52f0ba87/kube-auth-proxy/0.log"
Jul 09 17:31:17.679471 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:17.679385    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-656b79498-fhh6t_4c35b51d-1e89-414c-aabb-e207e27e4af6/router/0.log"
Jul 09 17:31:18.419097 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.419052    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znlmc_7fab8831-e9d1-4b0f-8b9b-26c8308f8c1d/serve-healthcheck-canary/0.log"
Jul 09 17:31:18.869458 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.869371    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nr7t8_b0c063fa-cfe0-4db5-b346-95fa68c4f678/insights-operator/0.log"
Jul 09 17:31:18.870624 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.870598    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nr7t8_b0c063fa-cfe0-4db5-b346-95fa68c4f678/insights-operator/1.log"
Jul 09 17:31:18.891129 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.891099    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h48lk_e24b974f-d9f5-4ab9-8d54-0ec6a41590ae/kube-rbac-proxy/0.log"
Jul 09 17:31:18.911217 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.911190    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h48lk_e24b974f-d9f5-4ab9-8d54-0ec6a41590ae/exporter/0.log"
Jul 09 17:31:18.932225 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:18.932172    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h48lk_e24b974f-d9f5-4ab9-8d54-0ec6a41590ae/extractor/0.log"
Jul 09 17:31:19.864846 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:19.863882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l7jhs/perf-node-gather-daemonset-j7n6g"
Jul 09 17:31:21.648691 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:21.648662    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kb7gr_1ace2155-3702-47c7-b89f-9f9e7a642b8c/server/0.log"
Jul 09 17:31:21.908386 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:21.908289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-wh2xw_03be99aa-424c-4ced-8cc6-c21d58081fd9/manager/0.log"
Jul 09 17:31:21.930150 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:21.930059    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdb769df8-wh2xw_03be99aa-424c-4ced-8cc6-c21d58081fd9/copy-manifests/0.log"
Jul 09 17:31:23.142969 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:23.142931    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44xsgk_5bd24181-3ca7-4e5e-89e7-52e750900ae2/istio-proxy/0.log"
Jul 09 17:31:23.330229 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:23.330198    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bzg67_4aebbefd-97a9-4aca-a7a0-dde059d933e2/discovery/0.log"
Jul 09 17:31:23.341267 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:23.341239    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b94bd4c99-6267q_7ea05c53-790d-45a5-83f9-8b4d52f0ba87/kube-auth-proxy/0.log"
Jul 09 17:31:23.575641 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:23.575612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-656b79498-fhh6t_4c35b51d-1e89-414c-aabb-e207e27e4af6/router/0.log"
Jul 09 17:31:24.714043 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:24.714009    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44xsgk_5bd24181-3ca7-4e5e-89e7-52e750900ae2/istio-proxy/0.log"
Jul 09 17:31:24.914891 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:24.913222    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bzg67_4aebbefd-97a9-4aca-a7a0-dde059d933e2/discovery/0.log"
Jul 09 17:31:24.927799 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:24.927762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b94bd4c99-6267q_7ea05c53-790d-45a5-83f9-8b4d52f0ba87/kube-auth-proxy/0.log"
Jul 09 17:31:25.162882 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:25.162848    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-656b79498-fhh6t_4c35b51d-1e89-414c-aabb-e207e27e4af6/router/0.log"
Jul 09 17:31:28.432097 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:28.432056    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-46p8l_52a1fd8c-77d3-4436-a1d6-e24b1bf057e7/kube-storage-version-migrator-operator/1.log"
Jul 09 17:31:28.433996 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:28.433967    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-46p8l_52a1fd8c-77d3-4436-a1d6-e24b1bf057e7/kube-storage-version-migrator-operator/0.log"
Jul 09 17:31:29.531730 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.531699    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/kube-multus-additional-cni-plugins/0.log"
Jul 09 17:31:29.551785 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.551753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/egress-router-binary-copy/0.log"
Jul 09 17:31:29.571931 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.571896    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/cni-plugins/0.log"
Jul 09 17:31:29.591586 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.591551    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/bond-cni-plugin/0.log"
Jul 09 17:31:29.616424 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.616394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/routeoverride-cni/0.log"
Jul 09 17:31:29.635602 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.635578    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/whereabouts-cni-bincopy/0.log"
Jul 09 17:31:29.655630 ip-10-0-135-121 kubenswrapper[2570]: I0709 17:31:29.655604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fplk_eee496b5-ee2d-4b49-8395-063901851612/whereabouts-cni/0.log"