Sep 09 18:29:34.360446 ip-10-0-135-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 18:29:34.360457 ip-10-0-135-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 18:29:34.360464 ip-10-0-135-73 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 18:29:34.360624 ip-10-0-135-73 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 18:29:44.505955 ip-10-0-135-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 18:29:44.505974 ip-10-0-135-73 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7967b35a80a84ab1b2a5fe0bad24f324 --
Sep 09 18:31:44.026713 ip-10-0-135-73 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 18:31:44.402445 ip-10-0-135-73 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 18:31:44.402445 ip-10-0-135-73 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 18:31:44.402445 ip-10-0-135-73 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 18:31:44.402445 ip-10-0-135-73 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 18:31:44.402445 ip-10-0-135-73 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 18:31:44.404078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.403988    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 18:31:44.409450 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409355    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409454    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409464    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409469    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409474    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409478    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409482    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409486    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409491    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409495    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409500    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409504    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409508    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409512    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409516    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409520    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409524    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409528    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409532    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409536    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.409543 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409544    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409550    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409557    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409561    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409565    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409569    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409573    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409577    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409581    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409585    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409589    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409593    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409597    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409601    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409605    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409609    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409613    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409617    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409621    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409625    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.410021 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409628    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409632    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409636    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409641    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409644    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409646    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409649    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409651    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409654    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409656    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409659    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409661    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409664    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409667    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409670    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409673    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409676    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409679    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409681    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409684    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.410517 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409687    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409689    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409694    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409697    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409699    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409702    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409705    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409708    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409712    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409716    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409720    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409724    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409727    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409730    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409733    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409736    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409739    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409742    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409745    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.411006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409748    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409750    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409753    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409756    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409760    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409764    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409767    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409770    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409773    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409776    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409778    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409781    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409783    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409786    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409789    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409791    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409794    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409796    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409799    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.409801    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.411469 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410574    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410582    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410586    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410590    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410592    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410595    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410598    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410601    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410604    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410607    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410610    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410612    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410615    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410618    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410620    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410623    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410625    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410629    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410632    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410634    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.411987 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410637    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410640    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410642    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410645    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410647    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410650    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410652    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410655    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410658    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410660    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410663    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410665    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410668    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410672    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410676    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410679    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410681    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410684    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410687    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410689    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.412503 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410693    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410696    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410698    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410703    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410706    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410709    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410712    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410715    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410718    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410721    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410724    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410726    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410729    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410732    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410734    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410737    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410739    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410742    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410744    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.413002 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410747    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410749    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410752    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410754    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410757    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410759    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410762    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410765    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410767    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410770    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410772    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410775    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410777    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410780    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410783    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410786    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410788    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410791    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410793    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410796    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.413505 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410798    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410800    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410803    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410807    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410810    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410813    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410815    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410818    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410820    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410823    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410825    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410827    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410832    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410835    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410838    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410841    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410843    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410846    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410849    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.410851    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.413997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411217    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411222    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411225    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411228    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411231    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411235    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411237    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411240    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411243    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411246    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411248    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411251    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411254    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411256    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411261    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411264    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411267    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411270    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411272    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411275    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.414508 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411278    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411281    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411284    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411286    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411289    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411291    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411294    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411296    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411299    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411302    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411304    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411307    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411309    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411312    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411315    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411318    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411320    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411323    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411327    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411329    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.414997 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411332    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411334    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411336    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411339    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411341    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411344    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411348    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411350    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411353    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411357    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411359    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411362    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411364    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411367    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411369    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411372    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411374    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411377    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411380    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411383    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.415506 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411388    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411411    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411415    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411418    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411421    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411423    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411426    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411430    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411434    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411437    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411439    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411442    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411445    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411447    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411450    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411452    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411455    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411458    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411462    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411464    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411467    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.416062 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411469    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411473    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411476    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411478    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411481    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411484    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411487    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411489    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411492    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411494    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411497    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411500    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411502    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411505    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411507    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411512    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411515    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.411518    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411600    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 18:31:44.416600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411645    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411652    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411656    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411660    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411663    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411667    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411672    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411675    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411678    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411681    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411685    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411688    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411691    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411694    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411697    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411701    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411704    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411708    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411711    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411714    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411717    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411720    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411724    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 18:31:44.417092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411727    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411729    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411733    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411736    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411739    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411742    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411745    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411747    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411753    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411756    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411759    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411762    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411765    2561 flags.go:64] FLAG: --enable-server="true"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411768    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411772    2561 flags.go:64] FLAG: --event-burst="100"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411775    2561 flags.go:64] FLAG: --event-qps="50"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411777    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411781    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411783    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411787    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411790    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411793    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411796    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411799    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411802    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 18:31:44.417673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411805    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411808    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411811    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411814    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411817    2561 flags.go:64] FLAG: --feature-gates=""
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411820    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411823    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411826    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411829    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411832    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411835    2561 flags.go:64] FLAG: --help="false"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411838    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411841    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411845    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411847    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411852    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411856    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411858    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411861    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411864    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411867    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411869    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411872    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411875    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 09 18:31:44.418313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411879    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411882    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411885    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411888    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411890    2561 flags.go:64] FLAG: --lock-file=""
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411893    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411896    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411899    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411905    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411908    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411910    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411913    2561 flags.go:64] FLAG: --logging-format="text"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411916    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411919    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411922    2561 flags.go:64] FLAG: --manifest-url=""
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411925    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411929    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411932    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411936    2561 flags.go:64] FLAG: --max-pods="110"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411939    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411941    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411944    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411947    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411951    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411954    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 18:31:44.418916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411957    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411964    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411967    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411970    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411973    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411976    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411981    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411983    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411986    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411989    2561 flags.go:64] FLAG: --port="10250"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411992    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411995    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a2bffdd3acd59282"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.411998    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412002    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412005    2561 flags.go:64] FLAG: --register-node="true"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412008    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412011    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412015    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412018    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412020    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412024    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412027    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412030    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412033    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412035    2561 flags.go:64] FLAG: --runonce="false"
Sep 09 18:31:44.419542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412038    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412041    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412044    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412046    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412049    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412053    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412056    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412059    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412062    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412065    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412068    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412070    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412073    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412076    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412079    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412086    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412089    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412091    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412096    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412098    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412101    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412104    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412107    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412110    2561 flags.go:64] FLAG: --v="2"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412114    2561 flags.go:64] FLAG: --version="false"
Sep 09 18:31:44.420191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412119    2561 flags.go:64] FLAG: --vmodule=""
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412123    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.412126    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412237    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412241    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412244    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412247    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412250    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412253    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412256    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412259    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412263    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412267    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412269    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412273    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412277    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412280    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412284    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412287    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.420837 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412290    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412292    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412295    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412299    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412302    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412304    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412307    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412310    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412312    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412315    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412318    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412321    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412323    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412326    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412329    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412331    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412334    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412336    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412339    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412341    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.421304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412344    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412347    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412350    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412352    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412355    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412357    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412360    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412362    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412365    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412367    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412370    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412372    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412375    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412377    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412380    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412383    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412386    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412402    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412406    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412410    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.421807 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412414    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412417    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412420    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412422    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412425    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412427    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412432    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412436    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412439    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412443    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412445    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412448    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412450    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412453    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412456    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412458    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412460    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412463    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412466    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.422293 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412468    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412471    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412474    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412476    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412478    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412481    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412484    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412486    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412490    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412493    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412495    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412498    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412500    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412503    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412506    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412508    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412511    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412514    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412516    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412521    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.422775 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412524    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412526    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412529    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.412532    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.413115    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.419721    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.419737    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.420386    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.420406    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420462    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420468    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420471    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420474    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420477    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420479    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.423268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420482    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420485    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420487    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420490    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420493    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420495    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420498    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420501    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420504    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420506    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420509    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420512    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420514    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420517    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420519    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420522    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420524    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420527    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420530    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420542    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.423683 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420546    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420548    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420551    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420555    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420560    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420564    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420567    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420570    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420573    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420576    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420579    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420581    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420584    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420587    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420590    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420592    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420596    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420599    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420603    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.424175 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420606    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420609    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420612    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420615    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420617    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420620    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420623    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420626    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420629    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420631    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420634    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420637    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420641    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420644    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420646    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420649    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420652    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420656    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420660    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420662    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.424758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420665    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420668    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420670    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420673    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420675    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420678    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420680    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420683    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420685    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420688    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420690    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420693    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420695    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420698    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420701    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420704    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420706    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420709    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420711    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420713    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.425244 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420716    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420718    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420721    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420724    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420727    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420730    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420732    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420735    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420738    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420741    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420744    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420746    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420749    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420751    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.420756    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 18:31:44.425738 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420865    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420869    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420872    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420874    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420877    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420880    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420883    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420885    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420888    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420890    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420893    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420896    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420899    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420901    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420904    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420906    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420909    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420911    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420914    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420916    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 18:31:44.426103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420919    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420921    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420924    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420927    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420930    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420932    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420935    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420938    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420941    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420943    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420946    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420948    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420951    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420953    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420956    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420958    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420961    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420963    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420966    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420968    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 18:31:44.426589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420971    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420973    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420976    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420978    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420981    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420984    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420986    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420989    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420991    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420994    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.420997    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421000    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421004    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421007    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421010    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421013    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421016    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421018    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421021    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 18:31:44.427079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421024    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421026    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421036    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421039    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421043    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421046    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421049    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421052    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421054    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421057    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421060    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421062    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421065    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421067    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421071    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421074    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421077    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421079    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421082    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 18:31:44.427562 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421085    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421087    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421090    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421093    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421095    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421098    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421100    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421103    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421106    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421108    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421111    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421114    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421118    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421122    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421126    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421129    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421134    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421137    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421141    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421145    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 18:31:44.428014 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:44.421149    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.421157    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.421294    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.423865    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.424672    2561 server.go:1019] "Starting client certificate rotation"
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.424773    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.425376    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 18:31:44.428568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.426781    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 18:31:44.430029 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.430012    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 18:31:44.440976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.440958    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 09 18:31:44.444791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.444775    2561 log.go:25] "Validated CRI v1 image API"
Sep 09 18:31:44.445572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.445559    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 18:31:44.449890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.449871    2561 fs.go:135] Filesystem UUIDs: map[508454f9-6db8-446b-8f08-6ba0eeb766d7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e28d34aa-897e-4028-8fd5-438d41a9b511:/dev/nvme0n1p3]
Sep 09 18:31:44.449959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.449889    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 18:31:44.453828 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.453809    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 18:31:44.455041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.454934    2561 manager.go:216] Machine: {Timestamp:2026-09-09 18:31:44.453555865 +0000 UTC m=+0.316493575 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106953 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ea10defbf260b703644c3dee519c SystemUUID:ec28ea10-defb-f260-b703-644c3dee519c BootID:7967b35a-80a8-4ab1-b2a5-fe0bad24f324 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:da:4a:13:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:da:4a:13:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:49:38:43:ac:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 18:31:44.455041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.455033    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 18:31:44.455171 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.455105    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 18:31:44.458228 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.458202    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 18:31:44.458353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.458229    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 18:31:44.458848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.458837    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 18:31:44.458923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.458850    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 18:31:44.458923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.458858    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 18:31:44.459464 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.459454    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 18:31:44.460484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.460474    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 18:31:44.463794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463783    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 18:31:44.463906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463896    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 18:31:44.463937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463925    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 18:31:44.463984 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463940    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 18:31:44.463984 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463963    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 18:31:44.463984 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463977    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 09 18:31:44.464096 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.463988    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 18:31:44.464378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.464359    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 18:31:44.464434 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.464382    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 18:31:44.467019 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.467005    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 18:31:44.468888 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.468874    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 18:31:44.468937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.468906    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 18:31:44.469078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469068    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 18:31:44.469115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469084    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 18:31:44.469115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469090    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 18:31:44.469115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469095    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 18:31:44.469115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469103    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 18:31:44.469229 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469124    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 18:31:44.469533 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469524    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 18:31:44.469565 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469535    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 18:31:44.469565 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469544    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 18:31:44.469565 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469551    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 18:31:44.469565 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469565    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 18:31:44.469668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.469573    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 18:31:44.470822 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.470809    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 18:31:44.470881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.470823    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 18:31:44.474444 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.474429    2561 server.go:1268] "Started kubelet"
Sep 09 18:31:44.474559 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.474489    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 18:31:44.474657 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.474563    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 18:31:44.474657 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.474635    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 18:31:44.475303 ip-10-0-135-73 systemd[1]: Started Kubernetes Kubelet.
Sep 09 18:31:44.477566 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.477541    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 18:31:44.478247 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.478220    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 18:31:44.478348 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.478274    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 18:31:44.478348 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.478281    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 18:31:44.479618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.479596    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 18:31:44.480773 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.480750    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 18:31:44.482315 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.481346    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-73.ec2.internal.18d3baa73eef2cb2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-73.ec2.internal,UID:ip-10-0-135-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-73.ec2.internal,},FirstTimestamp:2026-09-09 18:31:44.474385586 +0000 UTC m=+0.337323274,LastTimestamp:2026-09-09 18:31:44.474385586 +0000 UTC m=+0.337323274,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-73.ec2.internal,}"
Sep 09 18:31:44.483922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.483902    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 18:31:44.484551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.484523    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 18:31:44.484634 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.484615    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.485031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485013    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 18:31:44.485031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485032    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 18:31:44.485164 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485010    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 18:31:44.485164 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485105    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 18:31:44.485164 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485114    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 18:31:44.485260 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485191    2561 factory.go:55] Registering systemd factory
Sep 09 18:31:44.485260 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485224    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 09 18:31:44.485457 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485437    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w6wcr"
Sep 09 18:31:44.485457 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485446    2561 factory.go:153] Registering CRI-O factory
Sep 09 18:31:44.485542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485463    2561 factory.go:223] Registration of the crio container factory successfully
Sep 09 18:31:44.485542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485506    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 18:31:44.485542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485523    2561 factory.go:103] Registering Raw factory
Sep 09 18:31:44.485542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485539    2561 manager.go:1196] Started watching for new ooms in manager
Sep 09 18:31:44.485912 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.485899    2561 manager.go:349] Starting recovery of all containers
Sep 09 18:31:44.486229 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.486205    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 18:31:44.486367 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.486349    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 18:31:44.492753 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.492732    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w6wcr"
Sep 09 18:31:44.497256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.497103    2561 manager.go:354] Recovery completed
Sep 09 18:31:44.499473 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.499455    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 09 18:31:44.502446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.502417    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.505239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.505219    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.505319 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.505252    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.505319 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.505266    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.506347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.506334    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 18:31:44.506347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.506346    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 18:31:44.506524 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.506363    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 18:31:44.506524 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.506387    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.507190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.507163    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.507269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.507199    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.507269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.507209    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.508377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.508365    2561 policy_none.go:49] "None policy: Start"
Sep 09 18:31:44.508483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.508380    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 18:31:44.508483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.508402    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 18:31:44.510319 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.510306    2561 policy_none.go:47] "Start"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.549910    2561 manager.go:337] "Starting Device Plugin manager"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.549946    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.549955    2561 server.go:87] "Starting device plugin registration server"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.550241    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.550252    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.550345    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.550445    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.550454    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.551219    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 18:31:44.557945 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.551269    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.600589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.600550    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 18:31:44.601826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.601799    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 18:31:44.601908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.601862    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 18:31:44.601908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.601893    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 18:31:44.602009 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.601994    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 18:31:44.604429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.604413    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 18:31:44.650548 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.650526    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.651512 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.651496    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.651593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.651522    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.651593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.651555    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.651593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.651578    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.659478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.659422    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.659478 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.659445    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-73.ec2.internal\": node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.668944 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.668922    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.702524 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.702494    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"]
Sep 09 18:31:44.702631 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.702573    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.704117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.704099    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.704210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.704133    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.704210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.704148    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.706573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.706561    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.706701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.706685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.706757 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.706725    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.707367 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707351    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.707446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707379    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.707446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707410    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.707446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707438    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.707555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707454    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.707555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.707467    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.710241 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.710228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.710302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.710251    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 18:31:44.710914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.710895    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 18:31:44.710988 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.710926    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 18:31:44.710988 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.710942    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeHasSufficientPID"
Sep 09 18:31:44.726908 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.726888    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-73.ec2.internal\" not found" node="ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.730652 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.730636    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-73.ec2.internal\" not found" node="ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.769880 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.769857    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.870628 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.870576    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.885806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.885775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.885914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.885813    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.885914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.885839    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8c9cd701097f2fb518447aa67110d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-73.ec2.internal\" (UID: \"0bc8c9cd701097f2fb518447aa67110d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.971273 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:44.971198    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:44.986488 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.986580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.986580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8c9cd701097f2fb518447aa67110d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-73.ec2.internal\" (UID: \"0bc8c9cd701097f2fb518447aa67110d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.986674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.986674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb6d8e7c92c2aef901bdefe8be7cc3ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal\" (UID: \"fb6d8e7c92c2aef901bdefe8be7cc3ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:44.986674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:44.986638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc8c9cd701097f2fb518447aa67110d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-73.ec2.internal\" (UID: \"0bc8c9cd701097f2fb518447aa67110d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:45.029624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.029590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:45.033054 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.033032    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:45.071890 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.071654    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:45.173764 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.173714    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:45.274616 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.274528    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:45.375574 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.375525    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-73.ec2.internal\" not found"
Sep 09 18:31:45.423064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.423034    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 18:31:45.423602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.423583    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 18:31:45.424131 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.424113    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 18:31:45.424241 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.424223    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 18:31:45.464709 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.464683    2561 apiserver.go:52] "Watching apiserver"
Sep 09 18:31:45.483681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.483652    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 18:31:45.484007 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.483991    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 18:31:45.484050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.483992    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-s4xvv","openshift-dns/node-resolver-td2tq","openshift-image-registry/node-ca-b9jkw","openshift-multus/multus-additional-cni-plugins-cxswg","openshift-network-operator/iptables-alerter-nhdhf","openshift-ovn-kubernetes/ovnkube-node-74fsn","kube-system/global-pull-secret-syncer-ckq2d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd","openshift-cluster-node-tuning-operator/tuned-h8rk8","openshift-multus/multus-pwdmp","openshift-multus/network-metrics-daemon-nkprg","openshift-network-diagnostics/network-check-target-xf7fs"]
Sep 09 18:31:45.484959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.484941    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:45.486478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.486449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.488809 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.488782    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.488926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.488853    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 18:31:45.489712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.489563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xjcql\""
Sep 09 18:31:45.489712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.489573    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 18:31:45.489912 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.489822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b935d99-19cd-40df-8f84-7cfe74c2be6f-agent-certs\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.489912 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.489860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b935d99-19cd-40df-8f84-7cfe74c2be6f-konnectivity-ca\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.491509 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.491264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9l728\""
Sep 09 18:31:45.491509 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.491368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.491773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.491656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.492377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.491960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.493923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.493906    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.494283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.494242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 18:31:45.494326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.494283    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.494400 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.494381    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xs2rh\""
Sep 09 18:31:45.494755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.494731    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 18:31:45.494841 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.494773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.495820 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.495774    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 18:26:45 +0000 UTC" deadline="2028-04-11 06:14:11.302440161 +0000 UTC"
Sep 09 18:31:45.495820 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.495817    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13907h42m25.806625611s"
Sep 09 18:31:45.495960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.495934    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 18:31:45.496002 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.495988    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"
Sep 09 18:31:45.497003 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.496982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 18:31:45.497227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497212    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 18:31:45.497347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgbjg\""
Sep 09 18:31:45.497347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497265    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 18:31:45.497347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.497347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497327    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.497642 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.497586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.499708 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.499685    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.500039 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.500015    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2jx58\""
Sep 09 18:31:45.500102 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.500051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.500151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.500053    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 18:31:45.500583 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.500567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.502413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.502386    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 18:31:45.502881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.502857    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 18:31:45.502960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.502865    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-879b5\""
Sep 09 18:31:45.503265 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503243    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 18:31:45.503371 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503286    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 18:31:45.503371 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503296    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.503371 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.503550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.503604 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.503589    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 18:31:45.503650 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.503618    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:45.506248 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.506231    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.508612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.508594    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 18:31:45.508612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.508609    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.508800 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.508782    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tjf6c\""
Sep 09 18:31:45.509024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.509007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.509191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.509176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.511134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.511116    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:31:45.511904 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.511887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-plr25\""
Sep 09 18:31:45.512148 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.512132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.512948 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.512927    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 18:31:45.514362 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.514344    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 18:31:45.514428 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.514366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g5zzl\""
Sep 09 18:31:45.514887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.514871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.514974 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.514925    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:45.517759 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.517741    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal"]
Sep 09 18:31:45.517759 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.517766    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal"]
Sep 09 18:31:45.517933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.517835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:45.517933 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.517893    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:45.519426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.519408    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxdh2"
Sep 09 18:31:45.527482 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.527414    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxdh2"
Sep 09 18:31:45.553309 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.553285    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 18:31:45.586124 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.586098    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 18:31:45.590085 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b935d99-19cd-40df-8f84-7cfe74c2be6f-agent-certs\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.590193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.590193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-kubernetes\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.590193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-config\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-modprobe-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-var-lib-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-slash\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51faa0c6-1dbd-4781-8d94-b76416cac7b6-host\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-socket-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590378    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-systemd\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.590409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-host\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-systemd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-node-log\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-bin\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-multus\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b935d99-19cd-40df-8f84-7cfe74c2be6f-konnectivity-ca\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590561    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-kubelet\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-etc-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-log-socket\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-kubelet\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.590791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-multus-certs\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-etc-kubernetes\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-host-slash\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02deed6-0ece-448a-af83-5a70d6cc352a-tmp-dir\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.590951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-socket-dir-parent\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-hostroot\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-registration-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-conf\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brhz\" (UniqueName: \"kubernetes.io/projected/ccdcd749-f568-4d23-ba61-03891432f2f5-kube-api-access-6brhz\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-k8s-cni-cncf-io\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-bin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b935d99-19cd-40df-8f84-7cfe74c2be6f-konnectivity-ca\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-iptables-alerter-script\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdkgr\" (UniqueName: \"kubernetes.io/projected/fd296084-c8d3-4537-81fc-5066bea04684-kube-api-access-pdkgr\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-lib-modules\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.591413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ph5\" (UniqueName: \"kubernetes.io/projected/140317b5-400f-4e46-b304-34ffd18f5522-kube-api-access-82ph5\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-netns\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-cnibin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-run\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-netd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-dbus\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51faa0c6-1dbd-4781-8d94-b76416cac7b6-serviceca\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-cnibin\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-cni-binary-copy\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-conf-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4tp2\" (UniqueName: \"kubernetes.io/projected/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-kube-api-access-b4tp2\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.592194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-device-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-etc-tuned\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-tmp\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5h6\" (UniqueName: \"kubernetes.io/projected/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-kube-api-access-sh5h6\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.591996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-sys\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-ovn\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccdcd749-f568-4d23-ba61-03891432f2f5-ovn-node-metrics-cert\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-var-lib-kubelet\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hrt\" (UniqueName: \"kubernetes.io/projected/b823c112-cb31-41fb-b516-d9ec585903e4-kube-api-access-x5hrt\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x2pw\" (UniqueName: \"kubernetes.io/projected/d02deed6-0ece-448a-af83-5a70d6cc352a-kube-api-access-8x2pw\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-env-overrides\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-script-lib\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-kubelet-config\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-system-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.593055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p66z\" (UniqueName: \"kubernetes.io/projected/51faa0c6-1dbd-4781-8d94-b76416cac7b6-kube-api-access-6p66z\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-sys-fs\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-netns\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-daemon-config\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27nzx\" (UniqueName: \"kubernetes.io/projected/d10cf16f-7866-4cde-b24f-7bc147229dea-kube-api-access-27nzx\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-system-cni-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysconfig\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d02deed6-0ece-448a-af83-5a70d6cc352a-hosts-file\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.593625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.592617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-systemd-units\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.594512 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.594486    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b935d99-19cd-40df-8f84-7cfe74c2be6f-agent-certs\") pod \"konnectivity-agent-s4xvv\" (UID: \"0b935d99-19cd-40df-8f84-7cfe74c2be6f\") " pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.693295 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-conf-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4tp2\" (UniqueName: \"kubernetes.io/projected/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-kube-api-access-b4tp2\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-device-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-etc-tuned\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-tmp\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5h6\" (UniqueName: \"kubernetes.io/projected/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-kube-api-access-sh5h6\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-sys\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-conf-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.693458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-device-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-ovn\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-sys\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccdcd749-f568-4d23-ba61-03891432f2f5-ovn-node-metrics-cert\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-var-lib-kubelet\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-ovn\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-var-lib-kubelet\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hrt\" (UniqueName: \"kubernetes.io/projected/b823c112-cb31-41fb-b516-d9ec585903e4-kube-api-access-x5hrt\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x2pw\" (UniqueName: \"kubernetes.io/projected/d02deed6-0ece-448a-af83-5a70d6cc352a-kube-api-access-8x2pw\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-env-overrides\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-script-lib\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-kubelet-config\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.693891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-system-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p66z\" (UniqueName: \"kubernetes.io/projected/51faa0c6-1dbd-4781-8d94-b76416cac7b6-kube-api-access-6p66z\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-sys-fs\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.693979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-kubelet-config\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-netns\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-daemon-config\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27nzx\" (UniqueName: \"kubernetes.io/projected/d10cf16f-7866-4cde-b24f-7bc147229dea-kube-api-access-27nzx\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-system-cni-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysconfig\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-netns\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-system-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d02deed6-0ece-448a-af83-5a70d6cc352a-hosts-file\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-systemd-units\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-env-overrides\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.694813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-system-cni-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-kubernetes\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694281    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-systemd-units\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-config\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-kubernetes\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-modprobe-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-modprobe-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-var-lib-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-var-lib-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d02deed6-0ece-448a-af83-5a70d6cc352a-hosts-file\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysconfig\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-slash\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-config\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.695736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-slash\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51faa0c6-1dbd-4781-8d94-b76416cac7b6-host\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51faa0c6-1dbd-4781-8d94-b76416cac7b6-host\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-socket-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-systemd\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-host\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695149    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-d\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-systemd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-socket-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-node-log\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-host\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-run-systemd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-node-log\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-bin\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-systemd\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccdcd749-f568-4d23-ba61-03891432f2f5-ovnkube-script-lib\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.696676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-bin\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-multus\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-multus\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-kubelet\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.695406    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-etc-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-kubelet\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-log-socket\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-kubelet\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-etc-openvswitch\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-kubelet\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.695517    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:31:46.195478806 +0000 UTC m=+2.058416502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695544    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-log-socket\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-multus-certs\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.694254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-sys-fs\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-etc-kubernetes\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.697386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-host-slash\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02deed6-0ece-448a-af83-5a70d6cc352a-tmp-dir\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-etc-kubernetes\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-socket-dir-parent\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-host-slash\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-hostroot\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-registration-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-conf\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brhz\" (UniqueName: \"kubernetes.io/projected/ccdcd749-f568-4d23-ba61-03891432f2f5-kube-api-access-6brhz\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-k8s-cni-cncf-io\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-bin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-iptables-alerter-script\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkgr\" (UniqueName: \"kubernetes.io/projected/fd296084-c8d3-4537-81fc-5066bea04684-kube-api-access-pdkgr\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-lib-modules\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.698028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ph5\" (UniqueName: \"kubernetes.io/projected/140317b5-400f-4e46-b304-34ffd18f5522-kube-api-access-82ph5\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-netns\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696046    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02deed6-0ece-448a-af83-5a70d6cc352a-tmp-dir\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-k8s-cni-cncf-io\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-cni-dir\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-var-lib-cni-bin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-socket-dir-parent\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696183    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-hostroot\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd296084-c8d3-4537-81fc-5066bea04684-registration-dir\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-run-netns\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-cnibin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-run\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-lib-modules\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-netd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-dbus\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.698656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51faa0c6-1dbd-4781-8d94-b76416cac7b6-serviceca\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.695620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-host-run-multus-certs\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-run\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10cf16f-7866-4cde-b24f-7bc147229dea-cnibin\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-cnibin\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-cni-binary-copy\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696673    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-tmp\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b82c788-6c20-462a-a520-e582445f0279-dbus\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-iptables-alerter-script\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccdcd749-f568-4d23-ba61-03891432f2f5-host-cni-netd\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccdcd749-f568-4d23-ba61-03891432f2f5-ovn-node-metrics-cert\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.696780    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/140317b5-400f-4e46-b304-34ffd18f5522-cnibin\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.696832    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:31:46.196814692 +0000 UTC m=+2.059752396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.696837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b823c112-cb31-41fb-b516-d9ec585903e4-etc-sysctl-conf\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.697076    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51faa0c6-1dbd-4781-8d94-b76416cac7b6-serviceca\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.699206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.697209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b823c112-cb31-41fb-b516-d9ec585903e4-etc-tuned\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.699740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.697246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/140317b5-400f-4e46-b304-34ffd18f5522-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.699740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.697902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-cni-binary-copy\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.699740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.697965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d10cf16f-7866-4cde-b24f-7bc147229dea-multus-daemon-config\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.704904 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.704881    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:31:45.705012 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.704908    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:31:45.705012 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.704922    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:45.705012 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:45.704985    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:31:46.204969533 +0000 UTC m=+2.067907211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:45.706863 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.706832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4tp2\" (UniqueName: \"kubernetes.io/projected/5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0-kube-api-access-b4tp2\") pod \"iptables-alerter-nhdhf\" (UID: \"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0\") " pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.707257 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.707231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x2pw\" (UniqueName: \"kubernetes.io/projected/d02deed6-0ece-448a-af83-5a70d6cc352a-kube-api-access-8x2pw\") pod \"node-resolver-td2tq\" (UID: \"d02deed6-0ece-448a-af83-5a70d6cc352a\") " pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.707353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.707313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5h6\" (UniqueName: \"kubernetes.io/projected/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-kube-api-access-sh5h6\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:45.708000 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.707972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ph5\" (UniqueName: \"kubernetes.io/projected/140317b5-400f-4e46-b304-34ffd18f5522-kube-api-access-82ph5\") pod \"multus-additional-cni-plugins-cxswg\" (UID: \"140317b5-400f-4e46-b304-34ffd18f5522\") " pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.708178 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.708090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27nzx\" (UniqueName: \"kubernetes.io/projected/d10cf16f-7866-4cde-b24f-7bc147229dea-kube-api-access-27nzx\") pod \"multus-pwdmp\" (UID: \"d10cf16f-7866-4cde-b24f-7bc147229dea\") " pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.708318 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.708295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hrt\" (UniqueName: \"kubernetes.io/projected/b823c112-cb31-41fb-b516-d9ec585903e4-kube-api-access-x5hrt\") pod \"tuned-h8rk8\" (UID: \"b823c112-cb31-41fb-b516-d9ec585903e4\") " pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.708807 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.708784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p66z\" (UniqueName: \"kubernetes.io/projected/51faa0c6-1dbd-4781-8d94-b76416cac7b6-kube-api-access-6p66z\") pod \"node-ca-b9jkw\" (UID: \"51faa0c6-1dbd-4781-8d94-b76416cac7b6\") " pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.709586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.709559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdkgr\" (UniqueName: \"kubernetes.io/projected/fd296084-c8d3-4537-81fc-5066bea04684-kube-api-access-pdkgr\") pod \"aws-ebs-csi-driver-node-djpgd\" (UID: \"fd296084-c8d3-4537-81fc-5066bea04684\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.709665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.709641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brhz\" (UniqueName: \"kubernetes.io/projected/ccdcd749-f568-4d23-ba61-03891432f2f5-kube-api-access-6brhz\") pod \"ovnkube-node-74fsn\" (UID: \"ccdcd749-f568-4d23-ba61-03891432f2f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.718043 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.718019    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc8c9cd701097f2fb518447aa67110d.slice/crio-bc6766e82eeae74e8762239972a1ab46428500b1c718c5753cdf40222e596f0f WatchSource:0}: Error finding container bc6766e82eeae74e8762239972a1ab46428500b1c718c5753cdf40222e596f0f: Status 404 returned error can't find the container with id bc6766e82eeae74e8762239972a1ab46428500b1c718c5753cdf40222e596f0f
Sep 09 18:31:45.718268 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.718220    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6d8e7c92c2aef901bdefe8be7cc3ba.slice/crio-4a45699a35dd2e6bdd19f1dd43921156a01c4a6f8cfd8863c4dbf9640fb83d72 WatchSource:0}: Error finding container 4a45699a35dd2e6bdd19f1dd43921156a01c4a6f8cfd8863c4dbf9640fb83d72: Status 404 returned error can't find the container with id 4a45699a35dd2e6bdd19f1dd43921156a01c4a6f8cfd8863c4dbf9640fb83d72
Sep 09 18:31:45.724138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.724124    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 18:31:45.819239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.819151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:31:45.830642 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.830609    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b935d99_19cd_40df_8f84_7cfe74c2be6f.slice/crio-5bd587b7f6d96d0884ecf58bd73ceb663fd805832d653514319617536636a192 WatchSource:0}: Error finding container 5bd587b7f6d96d0884ecf58bd73ceb663fd805832d653514319617536636a192: Status 404 returned error can't find the container with id 5bd587b7f6d96d0884ecf58bd73ceb663fd805832d653514319617536636a192
Sep 09 18:31:45.843566 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.843533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-td2tq"
Sep 09 18:31:45.852006 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.851980    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02deed6_0ece_448a_af83_5a70d6cc352a.slice/crio-76d77f86e12f69415f5c00ca687f8d07690fd77cb78b1141c34509a7a74e2ac3 WatchSource:0}: Error finding container 76d77f86e12f69415f5c00ca687f8d07690fd77cb78b1141c34509a7a74e2ac3: Status 404 returned error can't find the container with id 76d77f86e12f69415f5c00ca687f8d07690fd77cb78b1141c34509a7a74e2ac3
Sep 09 18:31:45.861121 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.861100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b9jkw"
Sep 09 18:31:45.870753 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.870729    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51faa0c6_1dbd_4781_8d94_b76416cac7b6.slice/crio-9935df6c76bbb6599d1d6ebb91c55591318d232bb722451dfb520c1c20e1fc26 WatchSource:0}: Error finding container 9935df6c76bbb6599d1d6ebb91c55591318d232bb722451dfb520c1c20e1fc26: Status 404 returned error can't find the container with id 9935df6c76bbb6599d1d6ebb91c55591318d232bb722451dfb520c1c20e1fc26
Sep 09 18:31:45.874277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.874233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxswg"
Sep 09 18:31:45.882692 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.882669    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140317b5_400f_4e46_b304_34ffd18f5522.slice/crio-f4378b83b21acea14cdd71fcc810fe740edfc1434530cc42d4666c8373ec5d3b WatchSource:0}: Error finding container f4378b83b21acea14cdd71fcc810fe740edfc1434530cc42d4666c8373ec5d3b: Status 404 returned error can't find the container with id f4378b83b21acea14cdd71fcc810fe740edfc1434530cc42d4666c8373ec5d3b
Sep 09 18:31:45.888466 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.888448    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhdhf"
Sep 09 18:31:45.896735 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.896711    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1276d9_9173_4abd_98fc_ac8e8c2ba5c0.slice/crio-b5a76f68d12695e039e9372550a6b3fdcf1c6508c308ddbcf1246ae7cffc7290 WatchSource:0}: Error finding container b5a76f68d12695e039e9372550a6b3fdcf1c6508c308ddbcf1246ae7cffc7290: Status 404 returned error can't find the container with id b5a76f68d12695e039e9372550a6b3fdcf1c6508c308ddbcf1246ae7cffc7290
Sep 09 18:31:45.902230 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.902210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:31:45.910320 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.910302    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdcd749_f568_4d23_ba61_03891432f2f5.slice/crio-d09329b13e0c8949925003e45d6fdf06df3a8f9e39c2b0a0d4cbff949f93f5b9 WatchSource:0}: Error finding container d09329b13e0c8949925003e45d6fdf06df3a8f9e39c2b0a0d4cbff949f93f5b9: Status 404 returned error can't find the container with id d09329b13e0c8949925003e45d6fdf06df3a8f9e39c2b0a0d4cbff949f93f5b9
Sep 09 18:31:45.926165 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.926143    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd"
Sep 09 18:31:45.935554 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.935531    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd296084_c8d3_4537_81fc_5066bea04684.slice/crio-7ca19ccf0f8b4b82243e73a0ea33a516fb9a6c309c4a26a657f2bbc4d938d4fa WatchSource:0}: Error finding container 7ca19ccf0f8b4b82243e73a0ea33a516fb9a6c309c4a26a657f2bbc4d938d4fa: Status 404 returned error can't find the container with id 7ca19ccf0f8b4b82243e73a0ea33a516fb9a6c309c4a26a657f2bbc4d938d4fa
Sep 09 18:31:45.940870 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.940850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8rk8"
Sep 09 18:31:45.945890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:45.945868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwdmp"
Sep 09 18:31:45.950408 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.950171    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb823c112_cb31_41fb_b516_d9ec585903e4.slice/crio-fa28315a64e4ee0154b5364844ae07a97380bc14048b0c5835b81a2a1e680fcd WatchSource:0}: Error finding container fa28315a64e4ee0154b5364844ae07a97380bc14048b0c5835b81a2a1e680fcd: Status 404 returned error can't find the container with id fa28315a64e4ee0154b5364844ae07a97380bc14048b0c5835b81a2a1e680fcd
Sep 09 18:31:45.954653 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:31:45.954631    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10cf16f_7866_4cde_b24f_7bc147229dea.slice/crio-1b89846fc1f069d4128812d7c065e3c8a3415a85ecb4bf405e529e746f129bc1 WatchSource:0}: Error finding container 1b89846fc1f069d4128812d7c065e3c8a3415a85ecb4bf405e529e746f129bc1: Status 404 returned error can't find the container with id 1b89846fc1f069d4128812d7c065e3c8a3415a85ecb4bf405e529e746f129bc1
Sep 09 18:31:46.199813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.199711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:46.199813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.199773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:46.200051 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.199861    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:46.200051 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.199936    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:31:47.199914977 +0000 UTC m=+3.062852670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:46.200051 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.199866    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:46.200051 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.200013    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:31:47.199998089 +0000 UTC m=+3.062935767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:46.300088 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.300051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:46.300268 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.300236    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:31:46.300268 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.300260    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:31:46.300361 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.300272    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:46.300361 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:46.300333    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:31:47.300314552 +0000 UTC m=+3.163252235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:46.531374 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.531260    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 18:26:46 +0000 UTC" deadline="2028-05-24 23:37:53.403142148 +0000 UTC"
Sep 09 18:31:46.531374 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.531326    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14957h6m6.871821083s"
Sep 09 18:31:46.608822 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.608721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8rk8" event={"ID":"b823c112-cb31-41fb-b516-d9ec585903e4","Type":"ContainerStarted","Data":"fa28315a64e4ee0154b5364844ae07a97380bc14048b0c5835b81a2a1e680fcd"}
Sep 09 18:31:46.612346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.612256    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd" event={"ID":"fd296084-c8d3-4537-81fc-5066bea04684","Type":"ContainerStarted","Data":"7ca19ccf0f8b4b82243e73a0ea33a516fb9a6c309c4a26a657f2bbc4d938d4fa"}
Sep 09 18:31:46.615192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.615114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhdhf" event={"ID":"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0","Type":"ContainerStarted","Data":"b5a76f68d12695e039e9372550a6b3fdcf1c6508c308ddbcf1246ae7cffc7290"}
Sep 09 18:31:46.617388 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.617320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b9jkw" event={"ID":"51faa0c6-1dbd-4781-8d94-b76416cac7b6","Type":"ContainerStarted","Data":"9935df6c76bbb6599d1d6ebb91c55591318d232bb722451dfb520c1c20e1fc26"}
Sep 09 18:31:46.621717 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.621643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal" event={"ID":"fb6d8e7c92c2aef901bdefe8be7cc3ba","Type":"ContainerStarted","Data":"4a45699a35dd2e6bdd19f1dd43921156a01c4a6f8cfd8863c4dbf9640fb83d72"}
Sep 09 18:31:46.627348 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.627243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal" event={"ID":"0bc8c9cd701097f2fb518447aa67110d","Type":"ContainerStarted","Data":"bc6766e82eeae74e8762239972a1ab46428500b1c718c5753cdf40222e596f0f"}
Sep 09 18:31:46.630135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.630022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"d09329b13e0c8949925003e45d6fdf06df3a8f9e39c2b0a0d4cbff949f93f5b9"}
Sep 09 18:31:46.634970 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.634912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerStarted","Data":"f4378b83b21acea14cdd71fcc810fe740edfc1434530cc42d4666c8373ec5d3b"}
Sep 09 18:31:46.637564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.637504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-td2tq" event={"ID":"d02deed6-0ece-448a-af83-5a70d6cc352a","Type":"ContainerStarted","Data":"76d77f86e12f69415f5c00ca687f8d07690fd77cb78b1141c34509a7a74e2ac3"}
Sep 09 18:31:46.638898 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.638829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s4xvv" event={"ID":"0b935d99-19cd-40df-8f84-7cfe74c2be6f","Type":"ContainerStarted","Data":"5bd587b7f6d96d0884ecf58bd73ceb663fd805832d653514319617536636a192"}
Sep 09 18:31:46.640337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.640281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwdmp" event={"ID":"d10cf16f-7866-4cde-b24f-7bc147229dea","Type":"ContainerStarted","Data":"1b89846fc1f069d4128812d7c065e3c8a3415a85ecb4bf405e529e746f129bc1"}
Sep 09 18:31:46.820380 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:46.820094    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 18:31:47.209697 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.209608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:47.209697 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.209690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:47.209935 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.209837    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:47.209935 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.209903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:31:49.209882596 +0000 UTC m=+5.072820298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:47.210360 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.210336    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:47.210505 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.210398    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:31:49.210382182 +0000 UTC m=+5.073319882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:47.310680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.310639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:47.310908 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.310877    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:31:47.310908 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.310902    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:31:47.311042 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.310916    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:47.311042 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.310984    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:31:49.310964161 +0000 UTC m=+5.173901858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:47.532551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.532433    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 18:26:46 +0000 UTC" deadline="2028-03-05 07:35:10.199393233 +0000 UTC"
Sep 09 18:31:47.532551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.532488    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13021h3m22.666909797s"
Sep 09 18:31:47.602213 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.602182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:47.602432 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.602317    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:47.602785 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.602767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:47.602887 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.602871    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:47.602957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:47.602944    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:47.603049 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:47.603032    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:49.227894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.227798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:49.227894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.227886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:49.228368 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.228038    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:49.228368 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.228053    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:49.228368 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.228126    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:31:53.228095785 +0000 UTC m=+9.091033488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:49.228368 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.228148    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:31:53.22813753 +0000 UTC m=+9.091075212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:49.329136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.329093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:49.329345 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.329322    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:31:49.329345 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.329343    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:31:49.329480 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.329358    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:49.329480 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.329421    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:31:53.329406328 +0000 UTC m=+9.192344024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.602686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.602838    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.603290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.603411    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:49.603460    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:49.603659 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:49.603561    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:51.602778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:51.602929    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:51.603385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:51.603505    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:51.603571    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:51.603706 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:51.603661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.264189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.264269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.264358    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.264421    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.264453    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:01.264431748 +0000 UTC m=+17.127369431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:31:53.264773 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.264475    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:32:01.264464686 +0000 UTC m=+17.127402369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:31:53.365480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.365438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:53.365676 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.365594    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:31:53.365676 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.365619    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:31:53.365676 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.365629    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:53.365839 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.365699    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:32:01.365672968 +0000 UTC m=+17.228610646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:31:53.602947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.602821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:53.602947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.602879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:53.603151 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.602971    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:53.603151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:53.602823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:53.603151 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.603089    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:53.603285 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:53.603167    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:55.603209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:55.603039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:55.603209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:55.603069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:55.603209 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:55.603161    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:55.603924 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:55.603242    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:55.603924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:55.603289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:55.603924 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:55.603413    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:57.602407 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:57.602355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:57.602806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:57.602365    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:57.602806 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:57.602474    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:57.602806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:57.602369    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:57.602806 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:57.602663    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:31:57.602806 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:57.602591    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:59.603077 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:59.603040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:31:59.603638 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:59.603040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:31:59.603638 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:59.603167    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:31:59.603638 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:31:59.603040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:31:59.603638 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:59.603240    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:31:59.603638 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:31:59.603308    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:01.319903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.319862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:01.320432 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.319923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:01.320432 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.320063    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:32:01.320432 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.320080    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:32:01.320432 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.320116    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:32:17.320102298 +0000 UTC m=+33.183039974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:32:01.320432 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.320206    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:17.320186162 +0000 UTC m=+33.183123856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:32:01.420310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.420271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:01.420516 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.420435    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:32:01.420516 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.420458    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:32:01.420516 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.420471    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:32:01.420668 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.420533    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:32:17.420517881 +0000 UTC m=+33.283455585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:32:01.602945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.602861    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:01.602945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.602875    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:01.602945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:01.602875    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:01.603193 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.602981    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:01.603193 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.603039    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:01.603193 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:01.603121    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:03.603138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:03.603099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:03.603681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:03.603100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:03.603681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:03.603226    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:03.603681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:03.603118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:03.603681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:03.603303    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:03.603681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:03.603418    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:05.602494 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.602316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:05.603055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.602316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:05.603055 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:05.602571    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:05.603055 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:05.602639    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:05.603055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.602330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:05.603055 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:05.602706    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:05.687071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.687038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal" event={"ID":"0bc8c9cd701097f2fb518447aa67110d","Type":"ContainerStarted","Data":"cc775dd5265f16713094dadbad3993d666ec85c4a624f1a470d3460a0ffb556c"}
Sep 09 18:32:05.688894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.688817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"57a42883d63ffeb335d3da0ac3fd9d10afa57f84570c594c0e1b2bb24b83e433"}
Sep 09 18:32:05.701197 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.700987    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-73.ec2.internal" podStartSLOduration=19.700950851 podStartE2EDuration="19.700950851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:05.700858318 +0000 UTC m=+21.563796043" watchObservedRunningTime="2026-09-09 18:32:05.700950851 +0000 UTC m=+21.563888544"
Sep 09 18:32:05.713745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.713430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8rk8" event={"ID":"b823c112-cb31-41fb-b516-d9ec585903e4","Type":"ContainerStarted","Data":"7156b8ca90e429ae4e78725c05ee1d35e41ba022de93cecd0cb40ce3eddf60fe"}
Sep 09 18:32:05.730567 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:05.730494    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8rk8" podStartSLOduration=1.264630879 podStartE2EDuration="20.730471646s" totalImagesPullingTime="19.465840767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:05.729262024 +0000 UTC m=+21.592199749" watchObservedRunningTime="2026-09-09 18:32:05.730471646 +0000 UTC m=+21.593409345"
Sep 09 18:32:06.717957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.717694    2561 generic.go:356] "Generic (PLEG): container finished" podID="fb6d8e7c92c2aef901bdefe8be7cc3ba" containerID="84133399fccee68f53834f4fbd984cf438bfd608fcd17b86704cf4f5bf86fb4e" exitCode=0
Sep 09 18:32:06.718704 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.717789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal" event={"ID":"fb6d8e7c92c2aef901bdefe8be7cc3ba","Type":"ContainerDied","Data":"84133399fccee68f53834f4fbd984cf438bfd608fcd17b86704cf4f5bf86fb4e"}
Sep 09 18:32:06.721196 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721176    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:32:06.721612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721589    2561 generic.go:356] "Generic (PLEG): container finished" podID="ccdcd749-f568-4d23-ba61-03891432f2f5" containerID="cebfe427394686a3ecaebdfa2a2c2b7764ce2abf442f89349376c6b4685448c9" exitCode=1
Sep 09 18:32:06.721719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"574a5f73efd4dc65fcde32a7be9d7d9aaead0f2a0caa43390513c0ad88ec10c4"}
Sep 09 18:32:06.721776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"27c90a7fedef3d4cdba3ca566ccc8012174a5e212e35a9ed7438f155b0190536"}
Sep 09 18:32:06.721821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"9e93b48d952aa7c991d6414e6ae769e1be6d5a3a9919b3ccec64c51b1858594e"}
Sep 09 18:32:06.721868 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"7d6c2fa14d45e72ec4d72cc902cdcfc697754482453d520a8aa0002d231c5b28"}
Sep 09 18:32:06.721941 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.721915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerDied","Data":"cebfe427394686a3ecaebdfa2a2c2b7764ce2abf442f89349376c6b4685448c9"}
Sep 09 18:32:06.723121 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.723101    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="1fb3c890612ad107ce7a2b68be3259f1dfa70c059ba59271a945a3ac3e5af746" exitCode=0
Sep 09 18:32:06.723207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.723126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"1fb3c890612ad107ce7a2b68be3259f1dfa70c059ba59271a945a3ac3e5af746"}
Sep 09 18:32:06.724845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.724686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-td2tq" event={"ID":"d02deed6-0ece-448a-af83-5a70d6cc352a","Type":"ContainerStarted","Data":"e358d2cba6e307f94efd7dadafc54188a98738341139ef8488b274881e929845"}
Sep 09 18:32:06.726418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.726377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s4xvv" event={"ID":"0b935d99-19cd-40df-8f84-7cfe74c2be6f","Type":"ContainerStarted","Data":"072338a791d191b6f5418d93fe0d59798266a5faed4c5069015cd11e6a0aa027"}
Sep 09 18:32:06.727912 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.727891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwdmp" event={"ID":"d10cf16f-7866-4cde-b24f-7bc147229dea","Type":"ContainerStarted","Data":"8ff841c7f78217d4e593bc1de97e9b02e6b15ccf417bcf1921e1165a9b105947"}
Sep 09 18:32:06.729593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.729562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd" event={"ID":"fd296084-c8d3-4537-81fc-5066bea04684","Type":"ContainerStarted","Data":"d7473e2387f67c14ffe350968e22c17157f212e7e14251f37a56a9fa7819d8cd"}
Sep 09 18:32:06.731111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.731044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b9jkw" event={"ID":"51faa0c6-1dbd-4781-8d94-b76416cac7b6","Type":"ContainerStarted","Data":"a36d18231afdc0c9fd1a9d6ace69b41fe751ea725ad28da3aa0cf4326a44d3ea"}
Sep 09 18:32:06.745793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.745743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s4xvv" podStartSLOduration=2.156968227 podStartE2EDuration="21.745730256s" totalImagesPullingTime="19.588762029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:06.745257795 +0000 UTC m=+22.608195492" watchObservedRunningTime="2026-09-09 18:32:06.745730256 +0000 UTC m=+22.608667953"
Sep 09 18:32:06.758723 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.758680    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b9jkw" podStartSLOduration=9.518394958 podStartE2EDuration="21.75866268s" totalImagesPullingTime="12.240267722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:06.758327241 +0000 UTC m=+22.621264940" watchObservedRunningTime="2026-09-09 18:32:06.75866268 +0000 UTC m=+22.621600378"
Sep 09 18:32:06.775793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.775743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pwdmp" podStartSLOduration=2.101009776 podStartE2EDuration="21.775723432s" totalImagesPullingTime="19.674713656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:06.775038707 +0000 UTC m=+22.637976405" watchObservedRunningTime="2026-09-09 18:32:06.775723432 +0000 UTC m=+22.638661131"
Sep 09 18:32:06.789699 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:06.789642    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-td2tq" podStartSLOduration=2.241032996 podStartE2EDuration="21.789629409s" totalImagesPullingTime="19.548596413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:06.789468921 +0000 UTC m=+22.652406640" watchObservedRunningTime="2026-09-09 18:32:06.789629409 +0000 UTC m=+22.652567108"
Sep 09 18:32:07.080463 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.080414    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 18:32:07.562474 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.562333    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T18:32:07.080444273Z","UUID":"3569c0e4-3d3e-4680-bed6-c4a66e221bdc","Handler":null,"Name":"","Endpoint":""}
Sep 09 18:32:07.564152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.564128    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 18:32:07.564293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.564167    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 18:32:07.602498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.602462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:07.602657 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.602503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:07.602657 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.602553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:07.602657 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:07.602560    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:07.602785 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:07.602676    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:07.602785 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:07.602765    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:07.735959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.735923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd" event={"ID":"fd296084-c8d3-4537-81fc-5066bea04684","Type":"ContainerStarted","Data":"8e96aa4b5fd536d59467019b28f5eba3f09ddf747480b35265bdb10e932bac35"}
Sep 09 18:32:07.737484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.737451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhdhf" event={"ID":"5b1276d9-9173-4abd-98fc-ac8e8c2ba5c0","Type":"ContainerStarted","Data":"a2f5730bb2ad67859c2365e55e9e256ed059517bf0dc3096d727067d8b22fa6c"}
Sep 09 18:32:07.739502 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.739429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal" event={"ID":"fb6d8e7c92c2aef901bdefe8be7cc3ba","Type":"ContainerStarted","Data":"fb3af313484936d52d1e9f35b41eec4df773c6953d3992e82ae58a5251d4e595"}
Sep 09 18:32:07.750549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:07.750509    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nhdhf" podStartSLOduration=3.228273324 podStartE2EDuration="22.750496876s" totalImagesPullingTime="19.522223552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:07.750276022 +0000 UTC m=+23.613213739" watchObservedRunningTime="2026-09-09 18:32:07.750496876 +0000 UTC m=+23.613434574"
Sep 09 18:32:08.744107 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:08.744070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd" event={"ID":"fd296084-c8d3-4537-81fc-5066bea04684","Type":"ContainerStarted","Data":"e59c0ae25e3ffca0166cc1ca0d000788885b3bca0b8148aa4153dc13e6411b01"}
Sep 09 18:32:08.747324 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:08.747303    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:32:08.747706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:08.747688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"79b3343d002722507a85cba8d5c7523417c7a0519c2088c6242eba9cdf9bcd2f"}
Sep 09 18:32:08.760250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:08.760211    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-73.ec2.internal" podStartSLOduration=22.760198274 podStartE2EDuration="22.760198274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:07.762230087 +0000 UTC m=+23.625167786" watchObservedRunningTime="2026-09-09 18:32:08.760198274 +0000 UTC m=+24.623135951"
Sep 09 18:32:08.760680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:08.760653    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpgd" podStartSLOduration=2.539198144 podStartE2EDuration="23.76064279s" totalImagesPullingTime="21.221444646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:08.75920682 +0000 UTC m=+24.622144518" watchObservedRunningTime="2026-09-09 18:32:08.76064279 +0000 UTC m=+24.623580488"
Sep 09 18:32:09.602684 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:09.602648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:09.602881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:09.602690    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:09.602881 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:09.602768    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:09.602881 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:09.602809    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:09.602881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:09.602820    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:09.603034 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:09.602884    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:10.757438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.757344    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:32:10.757957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.757823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"4463b2105694d2d463e319ef686ae8cf805e50f851292e3a69c8c54abc41d78d"}
Sep 09 18:32:10.758434 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.758226    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:10.758434 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.758310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:10.758434 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.758319    2561 scope.go:117] "RemoveContainer" containerID="cebfe427394686a3ecaebdfa2a2c2b7764ce2abf442f89349376c6b4685448c9"
Sep 09 18:32:10.758434 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.758358    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:10.777407 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.777371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:10.777556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.777541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:10.884580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.884542    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:32:10.885564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:10.885550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:32:11.602509 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.602474    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:11.602509 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.602503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:11.602728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.602580    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:11.602728 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:11.602594    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:11.602728 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:11.602677    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:11.602869 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:11.602737    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:11.790414 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.788316    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:32:11.791120 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.791088    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" event={"ID":"ccdcd749-f568-4d23-ba61-03891432f2f5","Type":"ContainerStarted","Data":"d701579c61733359eddafa9b18285511e6564f7dde1efe1dd58f88d7717b7c33"}
Sep 09 18:32:11.791489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.791439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:32:11.792271 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.792124    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s4xvv"
Sep 09 18:32:11.816728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:11.816668    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn" podStartSLOduration=7.269084402 podStartE2EDuration="26.816651027s" totalImagesPullingTime="19.547566625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:11.815446757 +0000 UTC m=+27.678384502" watchObservedRunningTime="2026-09-09 18:32:11.816651027 +0000 UTC m=+27.679588726"
Sep 09 18:32:12.390270 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.390235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckq2d"]
Sep 09 18:32:12.390460 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.390368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:12.390527 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:12.390483    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:12.393089 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.392964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xf7fs"]
Sep 09 18:32:12.393429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.393257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:12.393429 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:12.393367    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:12.393780 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.393760    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkprg"]
Sep 09 18:32:12.394481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:12.393860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:12.394481 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:12.393953    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:13.602863 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:13.602828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:13.603589 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:13.602939    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:13.603589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:13.602993    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:13.603589 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:13.603089    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:13.796819 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:13.796786    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="296bce70f0cfcc73e3a1635373212a875f3e04d6150e6bb82e66e76f7b6c39ba" exitCode=0
Sep 09 18:32:13.796992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:13.796864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"296bce70f0cfcc73e3a1635373212a875f3e04d6150e6bb82e66e76f7b6c39ba"}
Sep 09 18:32:14.603332 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:14.603159    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:14.603783 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:14.603424    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:15.602864 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:15.602826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:15.603065 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:15.602951    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:15.603065 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:15.602998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:15.603172 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:15.603095    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:15.803954 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:15.803922    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="c096455539b07e919dbb69e3fdb6b4c66e0be405c7098c554333b8e258fa878c" exitCode=0
Sep 09 18:32:15.804426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:15.803969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"c096455539b07e919dbb69e3fdb6b4c66e0be405c7098c554333b8e258fa878c"}
Sep 09 18:32:16.603000 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:16.602957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:16.603180 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:16.603089    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:17.329138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.329099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:17.329611 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.329246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:17.329611 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.329273    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 18:32:17.329611 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.329348    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:32:17.329611 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.329354    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret podName:0b82c788-6c20-462a-a520-e582445f0279 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:49.329334912 +0000 UTC m=+65.192272603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret") pod "global-pull-secret-syncer-ckq2d" (UID: "0b82c788-6c20-462a-a520-e582445f0279") : object "kube-system"/"original-pull-secret" not registered
Sep 09 18:32:17.329611 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.329430    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:32:49.329388971 +0000 UTC m=+65.192326647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 18:32:17.429933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.429893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:17.430099 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.430055    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 18:32:17.430099 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.430076    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 18:32:17.430099 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.430087    2561 projected.go:196] Error preparing data for projected volume kube-api-access-9kchg for pod openshift-network-diagnostics/network-check-target-xf7fs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:32:17.430214 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.430137    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg podName:3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab nodeName:}" failed. No retries permitted until 2026-09-09 18:32:49.430122595 +0000 UTC m=+65.293060272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9kchg" (UniqueName: "kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg") pod "network-check-target-xf7fs" (UID: "3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 18:32:17.602919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.602843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:17.603069 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.602843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:17.603069 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.602952    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:32:17.603069 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:17.603015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xf7fs" podUID="3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab"
Sep 09 18:32:17.811178 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.811145    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="65e84cfe3a59111db3881df6cd3dc9290887d961286fc7942764db97270a94b8" exitCode=0
Sep 09 18:32:17.811338 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:17.811187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"65e84cfe3a59111db3881df6cd3dc9290887d961286fc7942764db97270a94b8"}
Sep 09 18:32:18.602495 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:18.602465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:18.602894 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:18.602582    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckq2d" podUID="0b82c788-6c20-462a-a520-e582445f0279"
Sep 09 18:32:19.387726 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.387692    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-73.ec2.internal" event="NodeReady"
Sep 09 18:32:19.387906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.387858    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 18:32:19.426945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.426857    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvm87"]
Sep 09 18:32:19.451426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.451379    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rwtwz"]
Sep 09 18:32:19.451615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.451506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.453681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.453651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 18:32:19.453849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.453707    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 18:32:19.453959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.453944    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dgjhb\""
Sep 09 18:32:19.471538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.471509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvm87"]
Sep 09 18:32:19.471672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.471552    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwtwz"]
Sep 09 18:32:19.471672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.471634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.474020 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.473994    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 18:32:19.474020 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.474014    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 18:32:19.474193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.474029    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 18:32:19.474193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.474059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4r989\""
Sep 09 18:32:19.543549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a3c247-eaee-4be8-994b-d9b4204eaca5-tmp-dir\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.543549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxdxk\" (UniqueName: \"kubernetes.io/projected/94a3c247-eaee-4be8-994b-d9b4204eaca5-kube-api-access-jxdxk\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.543756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.543756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f504bd-303b-429e-b0fc-497f42a5d68d-cert\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.543756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ntrn\" (UniqueName: \"kubernetes.io/projected/92f504bd-303b-429e-b0fc-497f42a5d68d-kube-api-access-7ntrn\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.543756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.543667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94a3c247-eaee-4be8-994b-d9b4204eaca5-config-volume\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.602486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.602447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:19.602662 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.602454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:19.605289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.605266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2784s\""
Sep 09 18:32:19.605454 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.605316    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 18:32:19.605454 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.605355    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 18:32:19.605454 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.605410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 18:32:19.605651 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.605599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbl9\""
Sep 09 18:32:19.644419 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f504bd-303b-429e-b0fc-497f42a5d68d-cert\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.644546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ntrn\" (UniqueName: \"kubernetes.io/projected/92f504bd-303b-429e-b0fc-497f42a5d68d-kube-api-access-7ntrn\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.644546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94a3c247-eaee-4be8-994b-d9b4204eaca5-config-volume\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.644546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a3c247-eaee-4be8-994b-d9b4204eaca5-tmp-dir\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.644546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxdxk\" (UniqueName: \"kubernetes.io/projected/94a3c247-eaee-4be8-994b-d9b4204eaca5-kube-api-access-jxdxk\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.644705 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.644584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.644705 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:19.644680    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:19.644783 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:19.644740    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:20.144721933 +0000 UTC m=+36.007659629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:19.645064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.645040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a3c247-eaee-4be8-994b-d9b4204eaca5-tmp-dir\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.645527 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.645499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94a3c247-eaee-4be8-994b-d9b4204eaca5-config-volume\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.648967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.648935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f504bd-303b-429e-b0fc-497f42a5d68d-cert\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.652771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.652736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxdxk\" (UniqueName: \"kubernetes.io/projected/94a3c247-eaee-4be8-994b-d9b4204eaca5-kube-api-access-jxdxk\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:19.652954 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.652934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ntrn\" (UniqueName: \"kubernetes.io/projected/92f504bd-303b-429e-b0fc-497f42a5d68d-kube-api-access-7ntrn\") pod \"ingress-canary-rwtwz\" (UID: \"92f504bd-303b-429e-b0fc-497f42a5d68d\") " pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:19.781512 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:19.781436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rwtwz"
Sep 09 18:32:20.106139 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:20.105885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rwtwz"]
Sep 09 18:32:20.109673 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:32:20.109643    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f504bd_303b_429e_b0fc_497f42a5d68d.slice/crio-c5e0ceac66ed3f09d21c050a79d478c29e271cbab99dfb50075289bbd6cfc2ef WatchSource:0}: Error finding container c5e0ceac66ed3f09d21c050a79d478c29e271cbab99dfb50075289bbd6cfc2ef: Status 404 returned error can't find the container with id c5e0ceac66ed3f09d21c050a79d478c29e271cbab99dfb50075289bbd6cfc2ef
Sep 09 18:32:20.148504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:20.148471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:20.148639 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:20.148625    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:20.148695 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:20.148684    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:21.14866996 +0000 UTC m=+37.011607636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:20.605471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:20.605440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:20.607814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:20.607790    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 18:32:20.819160 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:20.819119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwtwz" event={"ID":"92f504bd-303b-429e-b0fc-497f42a5d68d","Type":"ContainerStarted","Data":"c5e0ceac66ed3f09d21c050a79d478c29e271cbab99dfb50075289bbd6cfc2ef"}
Sep 09 18:32:21.155032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:21.154997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:21.155191 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:21.155157    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:21.155274 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:21.155221    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:23.155204721 +0000 UTC m=+39.018142420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:23.170510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:23.170466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:23.171315 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:23.170614    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:23.171315 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:23.170690    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:27.17067072 +0000 UTC m=+43.033608411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:23.829686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:23.829651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerStarted","Data":"1991367ebcb511960119223b8a5096549bdf33ccd7724c1b6e8055ce89955519"}
Sep 09 18:32:24.835252 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:24.835214    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="1991367ebcb511960119223b8a5096549bdf33ccd7724c1b6e8055ce89955519" exitCode=0
Sep 09 18:32:24.835685 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:24.835266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"1991367ebcb511960119223b8a5096549bdf33ccd7724c1b6e8055ce89955519"}
Sep 09 18:32:25.839379 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:25.839346    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rwtwz" event={"ID":"92f504bd-303b-429e-b0fc-497f42a5d68d","Type":"ContainerStarted","Data":"95430549e0918358f397425cf5a2a12303db5c7fddce8096f62cf3b52e2a9583"}
Sep 09 18:32:25.842681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:25.842657    2561 generic.go:356] "Generic (PLEG): container finished" podID="140317b5-400f-4e46-b304-34ffd18f5522" containerID="4015fed257dd04fc84b51821170918759c9943e16efbb104fa8595df9c2773c6" exitCode=0
Sep 09 18:32:25.842799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:25.842696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerDied","Data":"4015fed257dd04fc84b51821170918759c9943e16efbb104fa8595df9c2773c6"}
Sep 09 18:32:25.852735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:25.852688    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rwtwz" podStartSLOduration=1.263155594 podStartE2EDuration="6.852669579s" totalImagesPullingTime="5.589513985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:25.852373912 +0000 UTC m=+41.715311632" watchObservedRunningTime="2026-09-09 18:32:25.852669579 +0000 UTC m=+41.715607278"
Sep 09 18:32:26.848981 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:26.848944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxswg" event={"ID":"140317b5-400f-4e46-b304-34ffd18f5522","Type":"ContainerStarted","Data":"5e23e77fa43afd5339d0427c300b042ee203a3f66dfad1916a1466e10981e5e3"}
Sep 09 18:32:26.871365 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:26.869819    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxswg" podStartSLOduration=8.103790141 podStartE2EDuration="41.869796699s" totalImagesPullingTime="33.766006558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:26.868184291 +0000 UTC m=+42.731121990" watchObservedRunningTime="2026-09-09 18:32:26.869796699 +0000 UTC m=+42.732734399"
Sep 09 18:32:27.204050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:27.204014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:27.204214 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:27.204129    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:27.204214 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:27.204183    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:35.204169462 +0000 UTC m=+51.067107138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:35.260864 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:35.260803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:35.261297 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:35.260959    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:35.261297 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:35.261034    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:32:51.261018105 +0000 UTC m=+67.123955781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:42.802752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:42.802717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-74fsn"
Sep 09 18:32:49.361095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.361040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:49.361521 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.361119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:32:49.363470 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.363452    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 18:32:49.363563 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.363546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 18:32:49.371401 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:49.371374    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 18:32:49.371454 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:49.371443    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:33:53.371422586 +0000 UTC m=+129.234360279 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : secret "metrics-daemon-secret" not found
Sep 09 18:32:49.374037 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.374005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b82c788-6c20-462a-a520-e582445f0279-original-pull-secret\") pod \"global-pull-secret-syncer-ckq2d\" (UID: \"0b82c788-6c20-462a-a520-e582445f0279\") " pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:49.414348 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.414315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckq2d"
Sep 09 18:32:49.462308 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.461967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:49.465008 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.464987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 18:32:49.474953 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.474857    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 18:32:49.485785 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.485762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kchg\" (UniqueName: \"kubernetes.io/projected/3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab-kube-api-access-9kchg\") pod \"network-check-target-xf7fs\" (UID: \"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab\") " pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:49.616645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.616560    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbl9\""
Sep 09 18:32:49.625357 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.625334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:49.678409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.678311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckq2d"]
Sep 09 18:32:49.683768 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:32:49.683744    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b82c788_6c20_462a_a520_e582445f0279.slice/crio-7119958151d34a3e2922a0be17b7593405b508cde93f77c3b26f00b536778aff WatchSource:0}: Error finding container 7119958151d34a3e2922a0be17b7593405b508cde93f77c3b26f00b536778aff: Status 404 returned error can't find the container with id 7119958151d34a3e2922a0be17b7593405b508cde93f77c3b26f00b536778aff
Sep 09 18:32:49.886180 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.886103    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xf7fs"]
Sep 09 18:32:49.889414 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:32:49.889372    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5c6c0e_478c_4e46_8bb0_2c64f69ab4ab.slice/crio-05387ff2121825c085c29c0aa174e36c14c78b1829acadf5cb85e4767d7ab2d5 WatchSource:0}: Error finding container 05387ff2121825c085c29c0aa174e36c14c78b1829acadf5cb85e4767d7ab2d5: Status 404 returned error can't find the container with id 05387ff2121825c085c29c0aa174e36c14c78b1829acadf5cb85e4767d7ab2d5
Sep 09 18:32:49.908309 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.908277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xf7fs" event={"ID":"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab","Type":"ContainerStarted","Data":"05387ff2121825c085c29c0aa174e36c14c78b1829acadf5cb85e4767d7ab2d5"}
Sep 09 18:32:49.909716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:49.909693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckq2d" event={"ID":"0b82c788-6c20-462a-a520-e582445f0279","Type":"ContainerStarted","Data":"7119958151d34a3e2922a0be17b7593405b508cde93f77c3b26f00b536778aff"}
Sep 09 18:32:51.273662 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:51.273609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:32:51.274120 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:51.273770    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:32:51.274120 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:32:51.273837    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:33:23.273819701 +0000 UTC m=+99.136757394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:32:54.925610 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:54.925576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xf7fs" event={"ID":"3c5c6c0e-478c-4e46-8bb0-2c64f69ab4ab","Type":"ContainerStarted","Data":"fc8f344468d6d25a7819f59fe0e91d6b8ea6200f0c4d51867532682d05658bb2"}
Sep 09 18:32:54.926029 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:54.925664    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:32:54.927144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:54.927118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckq2d" event={"ID":"0b82c788-6c20-462a-a520-e582445f0279","Type":"ContainerStarted","Data":"680549659d2f747979fcf6c34183e81f28c22f41e3d1f02a1eed0fef7f2b5276"}
Sep 09 18:32:54.940055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:54.940007    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xf7fs" podStartSLOduration=65.237685313 podStartE2EDuration="1m9.939993414s" totalImagesPullingTime="4.702308101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:54.939003273 +0000 UTC m=+70.801940970" watchObservedRunningTime="2026-09-09 18:32:54.939993414 +0000 UTC m=+70.802931112"
Sep 09 18:32:54.954250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:32:54.954207    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ckq2d" podStartSLOduration=65.041341248 podStartE2EDuration="1m9.954194386s" totalImagesPullingTime="4.912853138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:32:54.953467293 +0000 UTC m=+70.816405004" watchObservedRunningTime="2026-09-09 18:32:54.954194386 +0000 UTC m=+70.817132084"
Sep 09 18:33:23.284062 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:33:23.284007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:33:23.284532 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:33:23.284147    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:33:23.284532 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:33:23.284226    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:34:27.284208418 +0000 UTC m=+163.147146093 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:33:25.931597 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:33:25.931563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xf7fs"
Sep 09 18:33:53.382030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:33:53.381969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:33:53.382545 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:33:53.382121    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 18:33:53.382545 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:33:53.382198    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs podName:89f4e062-d43f-4038-b8ca-ecd7320d2bfb nodeName:}" failed. No retries permitted until 2026-09-09 18:35:55.382179847 +0000 UTC m=+251.245117522 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs") pod "network-metrics-daemon-nkprg" (UID: "89f4e062-d43f-4038-b8ca-ecd7320d2bfb") : secret "metrics-daemon-secret" not found
Sep 09 18:34:22.462600 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:34:22.462543    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvm87" podUID="94a3c247-eaee-4be8-994b-d9b4204eaca5"
Sep 09 18:34:22.621000 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:34:22.620956    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nkprg" podUID="89f4e062-d43f-4038-b8ca-ecd7320d2bfb"
Sep 09 18:34:23.140112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:34:23.137762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:34:27.305889 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:34:27.305849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:34:27.306281 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:34:27.305959    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 18:34:27.306281 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:34:27.306011    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls podName:94a3c247-eaee-4be8-994b-d9b4204eaca5 nodeName:}" failed. No retries permitted until 2026-09-09 18:36:29.305996356 +0000 UTC m=+285.168934032 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls") pod "dns-default-gvm87" (UID: "94a3c247-eaee-4be8-994b-d9b4204eaca5") : secret "dns-default-metrics-tls" not found
Sep 09 18:34:34.603319 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:34:34.603283    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:35:18.773300 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.773269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mhbxb"]
Sep 09 18:35:18.776053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.776034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.778299 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.778274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 18:35:18.778426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.778275    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bbfnj\""
Sep 09 18:35:18.778705 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.778686    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 18:35:18.789963 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.789941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mhbxb"]
Sep 09 18:35:18.841407 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.841364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e6558b-f477-40e3-8043-09390d741210-nginx-conf\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.841569 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.841428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.865304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.865276    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"]
Sep 09 18:35:18.868050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.868034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:18.870429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.870406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vr4b9\""
Sep 09 18:35:18.870584 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.870416    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:35:18.870693 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.870418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 18:35:18.870693 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.870462    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 18:35:18.870693 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.870488    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 18:35:18.871750 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.871728    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"]
Sep 09 18:35:18.874355 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.874335    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75d4ff4d8d-hs5d8"]
Sep 09 18:35:18.874455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.874423    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:18.876283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.876254    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:35:18.876931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.876912    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 18:35:18.877038 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.876957    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 18:35:18.877038 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.876983    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.877201 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.877183    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2fnjz\""
Sep 09 18:35:18.877589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.877574    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 18:35:18.877798 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.877777    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"]
Sep 09 18:35:18.878986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.878968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 18:35:18.879060 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.879032    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 18:35:18.879571 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.879541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g44gk\""
Sep 09 18:35:18.879670 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.879541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 18:35:18.879670 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.879576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 18:35:18.879800 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.879784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 18:35:18.880331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.880310    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 18:35:18.886326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.886300    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"]
Sep 09 18:35:18.888430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.888411    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75d4ff4d8d-hs5d8"]
Sep 09 18:35:18.942127 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-serving-cert\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:18.942127 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e6558b-f477-40e3-8043-09390d741210-nginx-conf\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4thvg\" (UniqueName: \"kubernetes.io/projected/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-kube-api-access-4thvg\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-default-certificate\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:18.942314    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmg4t\" (UniqueName: \"kubernetes.io/projected/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-kube-api-access-rmg4t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:18.942353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-config\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:18.942834 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:18.942363    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:19.442348633 +0000 UTC m=+215.305286310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:18.942834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2787\" (UniqueName: \"kubernetes.io/projected/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-kube-api-access-p2787\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.942834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:18.942834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-stats-auth\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:18.943026 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.942951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e6558b-f477-40e3-8043-09390d741210-nginx-conf\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:18.968671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.968643    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:35:18.971659 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.971644    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:18.973768 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.973748    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 18:35:18.973887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.973749    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-74w6f\""
Sep 09 18:35:18.973952 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.973908    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 18:35:18.974127 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.974113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 18:35:18.978855 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.978833    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 18:35:18.984367 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:18.984347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:35:19.042964 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.042886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.042964 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.042929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.042964 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.042964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.042986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.043045    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmg4t\" (UniqueName: \"kubernetes.io/projected/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-kube-api-access-rmg4t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.043112    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:19.543095995 +0000 UTC m=+215.406033674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : secret "router-metrics-certs-default" not found
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xpc\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-config\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2787\" (UniqueName: \"kubernetes.io/projected/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-kube-api-access-p2787\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-stats-auth\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-serving-cert\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.043662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:19.543643082 +0000 UTC m=+215.406580800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:19.043686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4thvg\" (UniqueName: \"kubernetes.io/projected/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-kube-api-access-4thvg\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.044134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-default-certificate\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.044134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.043818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-config\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.045779 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.045752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-serving-cert\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.045903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.045865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.046132 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.046113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-stats-auth\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.046219 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.046199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-default-certificate\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.050702 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.050677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4thvg\" (UniqueName: \"kubernetes.io/projected/ee2685f6-a07a-42f1-a55d-23aea8fed7d7-kube-api-access-4thvg\") pod \"service-ca-operator-859f94c4b-5dlf2\" (UID: \"ee2685f6-a07a-42f1-a55d-23aea8fed7d7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.050812 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.050687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmg4t\" (UniqueName: \"kubernetes.io/projected/2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275-kube-api-access-rmg4t\") pod \"kube-storage-version-migrator-operator-8d7dd4675-58ntn\" (UID: \"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.051211 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.051194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2787\" (UniqueName: \"kubernetes.io/projected/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-kube-api-access-p2787\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.145059 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xpc\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.145498    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 18:35:19.145681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.145518    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9c77bfb7-scp7l: secret "image-registry-tls" not found
Sep 09 18:35:19.145681 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.145608    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls podName:e754f949-5ec3-43be-b332-fe93d8b6175c nodeName:}" failed. No retries permitted until 2026-09-09 18:35:19.645586416 +0000 UTC m=+215.508524113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls") pod "image-registry-7f9c77bfb7-scp7l" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c") : secret "image-registry-tls" not found
Sep 09 18:35:19.145826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.145940 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.145910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.146297 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.146279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.147581 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.147555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.147634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.147590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.154944 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.154917    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.155268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.155248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xpc\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.177947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.177918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"
Sep 09 18:35:19.188147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.188133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"
Sep 09 18:35:19.447150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.447112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:19.447302 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.447267    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:19.447354 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.447340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:20.447320827 +0000 UTC m=+216.310258523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:19.450217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.450186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2"]
Sep 09 18:35:19.454210 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:19.454184    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2685f6_a07a_42f1_a55d_23aea8fed7d7.slice/crio-b8e76530b7daaccde3ec7bc3dedaf6d58c72cf0b4a5809da35a0c44657a8f5a2 WatchSource:0}: Error finding container b8e76530b7daaccde3ec7bc3dedaf6d58c72cf0b4a5809da35a0c44657a8f5a2: Status 404 returned error can't find the container with id b8e76530b7daaccde3ec7bc3dedaf6d58c72cf0b4a5809da35a0c44657a8f5a2
Sep 09 18:35:19.469150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.469125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn"]
Sep 09 18:35:19.472224 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:19.472199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de0613f_d1cd_4b96_bd4e_b2fd4fcf6275.slice/crio-ccfeca3341b63cf674a0c36075d12c2a163cea04de002c5e02eb088e4ae9ec95 WatchSource:0}: Error finding container ccfeca3341b63cf674a0c36075d12c2a163cea04de002c5e02eb088e4ae9ec95: Status 404 returned error can't find the container with id ccfeca3341b63cf674a0c36075d12c2a163cea04de002c5e02eb088e4ae9ec95
Sep 09 18:35:19.547637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.547602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.547791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.547657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:19.547791 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.547774    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:20.547756879 +0000 UTC m=+216.410694554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:19.547875 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.547852    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 18:35:19.547912 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.547903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:20.547892493 +0000 UTC m=+216.410830170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : secret "router-metrics-certs-default" not found
Sep 09 18:35:19.648826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:19.648790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:19.648992 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.648933    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 18:35:19.648992 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.648953    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9c77bfb7-scp7l: secret "image-registry-tls" not found
Sep 09 18:35:19.649076 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:19.649004    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls podName:e754f949-5ec3-43be-b332-fe93d8b6175c nodeName:}" failed. No retries permitted until 2026-09-09 18:35:20.648990413 +0000 UTC m=+216.511928088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls") pod "image-registry-7f9c77bfb7-scp7l" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c") : secret "image-registry-tls" not found
Sep 09 18:35:20.272890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.272809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2" event={"ID":"ee2685f6-a07a-42f1-a55d-23aea8fed7d7","Type":"ContainerStarted","Data":"b8e76530b7daaccde3ec7bc3dedaf6d58c72cf0b4a5809da35a0c44657a8f5a2"}
Sep 09 18:35:20.274004 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.273975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn" event={"ID":"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275","Type":"ContainerStarted","Data":"ccfeca3341b63cf674a0c36075d12c2a163cea04de002c5e02eb088e4ae9ec95"}
Sep 09 18:35:20.455733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.455663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:20.455891 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.455838    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:20.455962 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.455909    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:22.455894901 +0000 UTC m=+218.318832576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:20.556857 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.556770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:20.557007 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.556859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:20.557007 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.556964    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:22.556946919 +0000 UTC m=+218.419884600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:20.557105 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.557031    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 18:35:20.557105 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.557090    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:22.557072386 +0000 UTC m=+218.420010067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : secret "router-metrics-certs-default" not found
Sep 09 18:35:20.658187 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:20.658138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:20.658373 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.658268    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 18:35:20.658373 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.658293    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9c77bfb7-scp7l: secret "image-registry-tls" not found
Sep 09 18:35:20.658373 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:20.658362    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls podName:e754f949-5ec3-43be-b332-fe93d8b6175c nodeName:}" failed. No retries permitted until 2026-09-09 18:35:22.658341795 +0000 UTC m=+218.521279476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls") pod "image-registry-7f9c77bfb7-scp7l" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c") : secret "image-registry-tls" not found
Sep 09 18:35:22.472373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.472324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:22.472803 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.472501    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:22.472803 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.472575    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.472557034 +0000 UTC m=+222.335494713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:22.572959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.572866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:22.572959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.572922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:22.573162 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.573005    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 18:35:22.573162 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.573052    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.5730299 +0000 UTC m=+222.435967585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:22.573162 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.573084    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.573074126 +0000 UTC m=+222.436011808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : secret "router-metrics-certs-default" not found
Sep 09 18:35:22.674188 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.674147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:22.674435 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.674324    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 18:35:22.674435 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.674348    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9c77bfb7-scp7l: secret "image-registry-tls" not found
Sep 09 18:35:22.674435 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:22.674419    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls podName:e754f949-5ec3-43be-b332-fe93d8b6175c nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.674402496 +0000 UTC m=+222.537340186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls") pod "image-registry-7f9c77bfb7-scp7l" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c") : secret "image-registry-tls" not found
Sep 09 18:35:22.859389 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.859312    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2f2cq"]
Sep 09 18:35:22.862611 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.862589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:22.864832 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.864805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 18:35:22.864943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.864846    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 18:35:22.864995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.864951    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 18:35:22.865695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.865677    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nn2fg\""
Sep 09 18:35:22.865806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.865716    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 18:35:22.870752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.870731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2f2cq"]
Sep 09 18:35:22.977513 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.977476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324c9404-a8b5-4765-8c00-0d764fa73acc-crio-socket\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:22.977672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.977526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:22.977672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.977625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:22.977746 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.977673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrsm9\" (UniqueName: \"kubernetes.io/projected/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-api-access-vrsm9\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:22.977746 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:22.977696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324c9404-a8b5-4765-8c00-0d764fa73acc-data-volume\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324c9404-a8b5-4765-8c00-0d764fa73acc-crio-socket\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrsm9\" (UniqueName: \"kubernetes.io/projected/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-api-access-vrsm9\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324c9404-a8b5-4765-8c00-0d764fa73acc-crio-socket\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.078901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.078861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324c9404-a8b5-4765-8c00-0d764fa73acc-data-volume\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.079103 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.078923    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 18:35:23.079103 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.078935    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:23.079103 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.078993    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:23.578974409 +0000 UTC m=+219.441912100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : configmap "kube-rbac-proxy" not found
Sep 09 18:35:23.079103 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.079022    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:23.579004553 +0000 UTC m=+219.441942230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:23.079267 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.079209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324c9404-a8b5-4765-8c00-0d764fa73acc-data-volume\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.086890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.086861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrsm9\" (UniqueName: \"kubernetes.io/projected/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-api-access-vrsm9\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.282971 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.282930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn" event={"ID":"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275","Type":"ContainerStarted","Data":"11093719a9f62c7ae368c49aa095341295f29528e270fdd3f5c6f37f19f6fd8c"}
Sep 09 18:35:23.284550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.284520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2" event={"ID":"ee2685f6-a07a-42f1-a55d-23aea8fed7d7","Type":"ContainerStarted","Data":"78a20c0d288f928ee7c417194d195afcd5e87bfc1a19c4172c90ccf6e3663cc6"}
Sep 09 18:35:23.296470 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.296415    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn" podStartSLOduration=2.47128027 podStartE2EDuration="5.296383462s" totalImagesPullingTime="2.825103192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:23.296222828 +0000 UTC m=+219.159160549" watchObservedRunningTime="2026-09-09 18:35:23.296383462 +0000 UTC m=+219.159321163"
Sep 09 18:35:23.583547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.583463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.583547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.583527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:23.583946 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.583615    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:23.583946 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.583629    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 18:35:23.583946 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.583690    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:24.58366697 +0000 UTC m=+220.446604650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:23.583946 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:23.583710    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:24.583701088 +0000 UTC m=+220.446638765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : configmap "kube-rbac-proxy" not found
Sep 09 18:35:23.736832 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.736775    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2" podStartSLOduration=2.8909325519999998 podStartE2EDuration="5.736755627s" totalImagesPullingTime="2.845823075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:23.309288307 +0000 UTC m=+219.172226017" watchObservedRunningTime="2026-09-09 18:35:23.736755627 +0000 UTC m=+219.599693364"
Sep 09 18:35:23.737087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.737071    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"]
Sep 09 18:35:23.740551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.740516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"
Sep 09 18:35:23.742845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.742816    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 18:35:23.742845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.742819    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wrkzp\""
Sep 09 18:35:23.743029 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.742825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 18:35:23.749550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.749525    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"]
Sep 09 18:35:23.885749 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.885651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzpsn\" (UniqueName: \"kubernetes.io/projected/0d805cca-d733-41e7-8157-186a268da136-kube-api-access-pzpsn\") pod \"migrator-fdbb8fdff-59587\" (UID: \"0d805cca-d733-41e7-8157-186a268da136\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"
Sep 09 18:35:23.986951 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.986909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzpsn\" (UniqueName: \"kubernetes.io/projected/0d805cca-d733-41e7-8157-186a268da136-kube-api-access-pzpsn\") pod \"migrator-fdbb8fdff-59587\" (UID: \"0d805cca-d733-41e7-8157-186a268da136\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"
Sep 09 18:35:23.994112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:23.994081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzpsn\" (UniqueName: \"kubernetes.io/projected/0d805cca-d733-41e7-8157-186a268da136-kube-api-access-pzpsn\") pod \"migrator-fdbb8fdff-59587\" (UID: \"0d805cca-d733-41e7-8157-186a268da136\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"
Sep 09 18:35:24.050319 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:24.050279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"
Sep 09 18:35:24.316141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:24.316099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587"]
Sep 09 18:35:24.319805 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:24.319778    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d805cca_d733_41e7_8157_186a268da136.slice/crio-d6da6ca4a3da83f395d402a76cf67e7f7cf91870541a47c81382cd96cb2e73b4 WatchSource:0}: Error finding container d6da6ca4a3da83f395d402a76cf67e7f7cf91870541a47c81382cd96cb2e73b4: Status 404 returned error can't find the container with id d6da6ca4a3da83f395d402a76cf67e7f7cf91870541a47c81382cd96cb2e73b4
Sep 09 18:35:24.592837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:24.592756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:24.593293 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:24.592887    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 18:35:24.593293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:24.592954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:24.593293 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:24.592965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.592945652 +0000 UTC m=+222.455883540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : configmap "kube-rbac-proxy" not found
Sep 09 18:35:24.593293 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:24.593083    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:24.593293 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:24.593127    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:26.59311568 +0000 UTC m=+222.456053360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:25.020862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:25.020833    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-td2tq_d02deed6-0ece-448a-af83-5a70d6cc352a/dns-node-resolver/0.log"
Sep 09 18:35:25.291848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:25.291765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587" event={"ID":"0d805cca-d733-41e7-8157-186a268da136","Type":"ContainerStarted","Data":"d6da6ca4a3da83f395d402a76cf67e7f7cf91870541a47c81382cd96cb2e73b4"}
Sep 09 18:35:25.821081 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:25.821048    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b9jkw_51faa0c6-1dbd-4781-8d94-b76416cac7b6/node-ca/0.log"
Sep 09 18:35:26.297746 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.297709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587" event={"ID":"0d805cca-d733-41e7-8157-186a268da136","Type":"ContainerStarted","Data":"99142e18f3b4a9e70906a4031a27ae0654cd1f031cfd9e6f17d5c486bd11207a"}
Sep 09 18:35:26.297910 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.297761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587" event={"ID":"0d805cca-d733-41e7-8157-186a268da136","Type":"ContainerStarted","Data":"1fb36b82ffd3aa01c04530fc96eace70d2cf58b3cd49b868d3cd46438051faff"}
Sep 09 18:35:26.312341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.312288    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-59587" podStartSLOduration=1.646348916 podStartE2EDuration="3.312272603s" totalImagesPullingTime="1.665923687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:26.31079129 +0000 UTC m=+222.173729020" watchObservedRunningTime="2026-09-09 18:35:26.312272603 +0000 UTC m=+222.175210300"
Sep 09 18:35:26.510026 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.509982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:26.510200 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.510138    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:26.510200 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.510198    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:34.510183559 +0000 UTC m=+230.373121239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:26.611342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.611303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:26.611549 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611444    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 18:35:26.611549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.611472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:26.611549 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611502    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:34.611486894 +0000 UTC m=+230.474424570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : secret "router-metrics-certs-default" not found
Sep 09 18:35:26.611549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.611540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611566    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611599    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.611569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611618    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:30.611601842 +0000 UTC m=+226.474539538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:34.611644258 +0000 UTC m=+230.474581940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:26.611741 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.611677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:30.61166749 +0000 UTC m=+226.474605166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : configmap "kube-rbac-proxy" not found
Sep 09 18:35:26.623518 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.623496    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwtwz_92f504bd-303b-429e-b0fc-497f42a5d68d/serve-healthcheck-canary/0.log"
Sep 09 18:35:26.712780 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:26.712743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:26.712940 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.712903    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 18:35:26.712940 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.712918    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9c77bfb7-scp7l: secret "image-registry-tls" not found
Sep 09 18:35:26.713006 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:26.712971    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls podName:e754f949-5ec3-43be-b332-fe93d8b6175c nodeName:}" failed. No retries permitted until 2026-09-09 18:35:34.712956606 +0000 UTC m=+230.575894309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls") pod "image-registry-7f9c77bfb7-scp7l" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c") : secret "image-registry-tls" not found
Sep 09 18:35:30.641539 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:30.641500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:30.641919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:30.641565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:30.641919 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:30.641642    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:30.641919 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:30.641655    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 18:35:30.641919 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:30.641709    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:38.641690615 +0000 UTC m=+234.504628308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : configmap "kube-rbac-proxy" not found
Sep 09 18:35:30.641919 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:30.641734    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:38.641723745 +0000 UTC m=+234.504661436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:34.572702 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.572665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:34.573071 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:34.572810    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 18:35:34.573071 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:34.572875    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert podName:01e6558b-f477-40e3-8043-09390d741210 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:50.572860011 +0000 UTC m=+246.435797687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-mhbxb" (UID: "01e6558b-f477-40e3-8043-09390d741210") : secret "networking-console-plugin-cert" not found
Sep 09 18:35:34.673617 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.673582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:34.673813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.673653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:34.673813 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:34.673786    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle podName:8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622 nodeName:}" failed. No retries permitted until 2026-09-09 18:35:50.673770429 +0000 UTC m=+246.536708106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle") pod "router-default-75d4ff4d8d-hs5d8" (UID: "8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622") : configmap references non-existent config key: service-ca.crt
Sep 09 18:35:34.675995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.675961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-metrics-certs\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:34.774327 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.774284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:34.776768 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.776749    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"image-registry-7f9c77bfb7-scp7l\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") " pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:34.880987 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:34.880890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:35.151002 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:35.150968    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:35:35.153802 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:35.153777    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode754f949_5ec3_43be_b332_fe93d8b6175c.slice/crio-45883c37a4e50ae9ebc307177063f35645c8c1c1d3864184b952f8285e929735 WatchSource:0}: Error finding container 45883c37a4e50ae9ebc307177063f35645c8c1c1d3864184b952f8285e929735: Status 404 returned error can't find the container with id 45883c37a4e50ae9ebc307177063f35645c8c1c1d3864184b952f8285e929735
Sep 09 18:35:35.325719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:35.325686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" event={"ID":"e754f949-5ec3-43be-b332-fe93d8b6175c","Type":"ContainerStarted","Data":"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"}
Sep 09 18:35:35.325887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:35.325735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" event={"ID":"e754f949-5ec3-43be-b332-fe93d8b6175c","Type":"ContainerStarted","Data":"45883c37a4e50ae9ebc307177063f35645c8c1c1d3864184b952f8285e929735"}
Sep 09 18:35:35.325887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:35.325783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:35:35.342589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:35.342526    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" podStartSLOduration=17.342510462 podStartE2EDuration="17.342510462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:35.341538233 +0000 UTC m=+231.204475952" watchObservedRunningTime="2026-09-09 18:35:35.342510462 +0000 UTC m=+231.205448199"
Sep 09 18:35:38.708220 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:38.708177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:38.708677 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:38.708265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:38.708677 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:38.708344    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:38.708677 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:35:38.708440    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls podName:324c9404-a8b5-4765-8c00-0d764fa73acc nodeName:}" failed. No retries permitted until 2026-09-09 18:35:54.708420544 +0000 UTC m=+250.571358238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2f2cq" (UID: "324c9404-a8b5-4765-8c00-0d764fa73acc") : secret "insights-runtime-extractor-tls" not found
Sep 09 18:35:38.708806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:38.708786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324c9404-a8b5-4765-8c00-0d764fa73acc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:50.234275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.234238    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:35:50.238698 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.238660    2561 patch_prober.go:28] interesting pod/image-registry-7f9c77bfb7-scp7l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 18:35:50.238837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.238712    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 18:35:50.597628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.597531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:50.600006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.599979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e6558b-f477-40e3-8043-09390d741210-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mhbxb\" (UID: \"01e6558b-f477-40e3-8043-09390d741210\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:50.698512 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.698475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:50.699069 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.699048    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622-service-ca-bundle\") pod \"router-default-75d4ff4d8d-hs5d8\" (UID: \"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622\") " pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:50.886447 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.886350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bbfnj\""
Sep 09 18:35:50.894993 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.894971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb"
Sep 09 18:35:50.996026 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:50.995994    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g44gk\""
Sep 09 18:35:51.004784 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.004763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:51.163814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.163782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mhbxb"]
Sep 09 18:35:51.167256 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:51.167217    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e6558b_f477_40e3_8043_09390d741210.slice/crio-1e8bd2d1b85895ca72a0316e76b446606602132644c377d98c27967c003488c2 WatchSource:0}: Error finding container 1e8bd2d1b85895ca72a0316e76b446606602132644c377d98c27967c003488c2: Status 404 returned error can't find the container with id 1e8bd2d1b85895ca72a0316e76b446606602132644c377d98c27967c003488c2
Sep 09 18:35:51.272897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.272867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75d4ff4d8d-hs5d8"]
Sep 09 18:35:51.275757 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:51.275733    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d69fb47_1ad6_4cdd_b4c4_f9f1bb865622.slice/crio-44e785ad88f74ecda576b05add5a95ba96a2664d23d013f7923aae4e7a6999c9 WatchSource:0}: Error finding container 44e785ad88f74ecda576b05add5a95ba96a2664d23d013f7923aae4e7a6999c9: Status 404 returned error can't find the container with id 44e785ad88f74ecda576b05add5a95ba96a2664d23d013f7923aae4e7a6999c9
Sep 09 18:35:51.376414 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.376359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb" event={"ID":"01e6558b-f477-40e3-8043-09390d741210","Type":"ContainerStarted","Data":"1e8bd2d1b85895ca72a0316e76b446606602132644c377d98c27967c003488c2"}
Sep 09 18:35:51.377848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.377816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8" event={"ID":"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622","Type":"ContainerStarted","Data":"871756804cfd8187106ad7976ffe624ffa99ca71fc0d1941482298b4fabbb052"}
Sep 09 18:35:51.377986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.377863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8" event={"ID":"8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622","Type":"ContainerStarted","Data":"44e785ad88f74ecda576b05add5a95ba96a2664d23d013f7923aae4e7a6999c9"}
Sep 09 18:35:51.394089 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:51.394037    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8" podStartSLOduration=33.39402137 podStartE2EDuration="33.39402137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:51.393478062 +0000 UTC m=+247.256415772" watchObservedRunningTime="2026-09-09 18:35:51.39402137 +0000 UTC m=+247.256959068"
Sep 09 18:35:52.005572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:52.005533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:52.008035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:52.008008    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:52.381002 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:52.380937    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:52.382313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:52.382292    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75d4ff4d8d-hs5d8"
Sep 09 18:35:53.390178 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:53.390140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb" event={"ID":"01e6558b-f477-40e3-8043-09390d741210","Type":"ContainerStarted","Data":"8bc1164954af40bfcce378620052fe35079c832ecfb03c143355d5c4ae823adf"}
Sep 09 18:35:53.403482 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:53.403430    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-mhbxb" podStartSLOduration=34.132834056 podStartE2EDuration="35.403412791s" totalImagesPullingTime="1.270578735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:53.402882808 +0000 UTC m=+249.265820523" watchObservedRunningTime="2026-09-09 18:35:53.403412791 +0000 UTC m=+249.266350481"
Sep 09 18:35:54.731016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:54.730971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:54.733216 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:54.733195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324c9404-a8b5-4765-8c00-0d764fa73acc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2f2cq\" (UID: \"324c9404-a8b5-4765-8c00-0d764fa73acc\") " pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:54.974573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:54.974534    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nn2fg\""
Sep 09 18:35:54.983150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:54.983088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2f2cq"
Sep 09 18:35:55.254342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.254262    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2f2cq"]
Sep 09 18:35:55.256976 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:55.256950    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324c9404_a8b5_4765_8c00_0d764fa73acc.slice/crio-ffc66d8f9b06506b0dc14bfc284a3269d134063e0fdd9efbb3b749f14632b924 WatchSource:0}: Error finding container ffc66d8f9b06506b0dc14bfc284a3269d134063e0fdd9efbb3b749f14632b924: Status 404 returned error can't find the container with id ffc66d8f9b06506b0dc14bfc284a3269d134063e0fdd9efbb3b749f14632b924
Sep 09 18:35:55.398213 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.398171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2f2cq" event={"ID":"324c9404-a8b5-4765-8c00-0d764fa73acc","Type":"ContainerStarted","Data":"6ec8de6e12ec2a2648ea5f7619467b1d8925a61c4a3f036fb5aff9b09eb22a24"}
Sep 09 18:35:55.398363 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.398244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2f2cq" event={"ID":"324c9404-a8b5-4765-8c00-0d764fa73acc","Type":"ContainerStarted","Data":"ffc66d8f9b06506b0dc14bfc284a3269d134063e0fdd9efbb3b749f14632b924"}
Sep 09 18:35:55.436793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.436758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:35:55.439052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.439033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f4e062-d43f-4038-b8ca-ecd7320d2bfb-metrics-certs\") pod \"network-metrics-daemon-nkprg\" (UID: \"89f4e062-d43f-4038-b8ca-ecd7320d2bfb\") " pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:35:55.606611 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.606527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2784s\""
Sep 09 18:35:55.615131 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.615107    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nkprg"
Sep 09 18:35:55.880588 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:55.880508    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nkprg"]
Sep 09 18:35:55.883478 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:35:55.883445    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f4e062_d43f_4038_b8ca_ecd7320d2bfb.slice/crio-7d9f165757bd23b39e4fd2cd09172ff19d9aa95fa7409ee0a79bdce720ced41b WatchSource:0}: Error finding container 7d9f165757bd23b39e4fd2cd09172ff19d9aa95fa7409ee0a79bdce720ced41b: Status 404 returned error can't find the container with id 7d9f165757bd23b39e4fd2cd09172ff19d9aa95fa7409ee0a79bdce720ced41b
Sep 09 18:35:56.402589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:56.402553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkprg" event={"ID":"89f4e062-d43f-4038-b8ca-ecd7320d2bfb","Type":"ContainerStarted","Data":"7d9f165757bd23b39e4fd2cd09172ff19d9aa95fa7409ee0a79bdce720ced41b"}
Sep 09 18:35:57.407256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:57.407220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkprg" event={"ID":"89f4e062-d43f-4038-b8ca-ecd7320d2bfb","Type":"ContainerStarted","Data":"df8c273b38e0143df35126c2eed27600f8c3d9e34de28601a37f4b98ab14952a"}
Sep 09 18:35:57.407646 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:57.407282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nkprg" event={"ID":"89f4e062-d43f-4038-b8ca-ecd7320d2bfb","Type":"ContainerStarted","Data":"9ccd5c7beb6d057335bc361640ad473d8cb4d25966babc102945fd367ee1e69d"}
Sep 09 18:35:57.422543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:57.422497    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nkprg" podStartSLOduration=251.100439149 podStartE2EDuration="4m12.42248096s" totalImagesPullingTime="1.322041811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:35:57.42223577 +0000 UTC m=+253.285173492" watchObservedRunningTime="2026-09-09 18:35:57.42248096 +0000 UTC m=+253.285418672"
Sep 09 18:35:58.412326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:58.412291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2f2cq" event={"ID":"324c9404-a8b5-4765-8c00-0d764fa73acc","Type":"ContainerStarted","Data":"ccb9d8fa7079c35824db97d26eb6846cbf1c5c6b423cf9ddb1b3e82558a5c2a0"}
Sep 09 18:35:59.759313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.759234    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"]
Sep 09 18:35:59.762266 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.762250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.764383 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.764358    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 18:35:59.764479 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.764367    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 18:35:59.765352 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.765327    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 18:35:59.765496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.765407    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n2cc6\""
Sep 09 18:35:59.765496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.765420    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 18:35:59.765496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.765483    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 18:35:59.771897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.771879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"]
Sep 09 18:35:59.874151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.874117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e43b02-2817-46fe-8161-654073192a58-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.874151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.874153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.874359 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.874176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgmc\" (UniqueName: \"kubernetes.io/projected/e3e43b02-2817-46fe-8161-654073192a58-kube-api-access-ntgmc\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.874359 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.874278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.974759 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.974725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgmc\" (UniqueName: \"kubernetes.io/projected/e3e43b02-2817-46fe-8161-654073192a58-kube-api-access-ntgmc\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.974965 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.974799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.974965 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.974827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e43b02-2817-46fe-8161-654073192a58-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.974965 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.974844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.975497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.975466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3e43b02-2817-46fe-8161-654073192a58-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.977262 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.977230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.977366 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.977263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3e43b02-2817-46fe-8161-654073192a58-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:35:59.981458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:35:59.981433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgmc\" (UniqueName: \"kubernetes.io/projected/e3e43b02-2817-46fe-8161-654073192a58-kube-api-access-ntgmc\") pod \"prometheus-operator-6f4946db56-fbh2c\" (UID: \"e3e43b02-2817-46fe-8161-654073192a58\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:36:00.070765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.070661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"
Sep 09 18:36:00.239534 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.239498    2561 patch_prober.go:28] interesting pod/image-registry-7f9c77bfb7-scp7l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 18:36:00.239700 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.239550    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 18:36:00.336347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.336276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fbh2c"]
Sep 09 18:36:00.338899 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:00.338873    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e43b02_2817_46fe_8161_654073192a58.slice/crio-643b498e9c7784a600928db755c7fe5dc36b6ad8746a98fbf3e7217a53542f36 WatchSource:0}: Error finding container 643b498e9c7784a600928db755c7fe5dc36b6ad8746a98fbf3e7217a53542f36: Status 404 returned error can't find the container with id 643b498e9c7784a600928db755c7fe5dc36b6ad8746a98fbf3e7217a53542f36
Sep 09 18:36:00.421169 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.421134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2f2cq" event={"ID":"324c9404-a8b5-4765-8c00-0d764fa73acc","Type":"ContainerStarted","Data":"ddf975fb307e82b5febd06911ff8071a69443ed35f7b24cebc477d36e4392a43"}
Sep 09 18:36:00.422410 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.422373    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c" event={"ID":"e3e43b02-2817-46fe-8161-654073192a58","Type":"ContainerStarted","Data":"643b498e9c7784a600928db755c7fe5dc36b6ad8746a98fbf3e7217a53542f36"}
Sep 09 18:36:00.440149 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:00.440107    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2f2cq" podStartSLOduration=34.322961959 podStartE2EDuration="38.44009236s" totalImagesPullingTime="4.117130401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 18:35:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:00.439499051 +0000 UTC m=+256.302436764" watchObservedRunningTime="2026-09-09 18:36:00.44009236 +0000 UTC m=+256.303030057"
Sep 09 18:36:02.431145 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:02.431107    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c" event={"ID":"e3e43b02-2817-46fe-8161-654073192a58","Type":"ContainerStarted","Data":"22533bb4cd4d3514a251b127496f217143c21c5eb97ac1373f6e9a76d4448f00"}
Sep 09 18:36:02.431539 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:02.431168    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c" event={"ID":"e3e43b02-2817-46fe-8161-654073192a58","Type":"ContainerStarted","Data":"8c2ff78a0adbffe8bd3139becbdef5b3d95a37cf19689c7628802ee319ef278c"}
Sep 09 18:36:02.446130 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:02.446078    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-fbh2c" podStartSLOduration=2.159363581 podStartE2EDuration="3.446063051s" totalImagesPullingTime="1.28669947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:02.445176014 +0000 UTC m=+258.308113728" watchObservedRunningTime="2026-09-09 18:36:02.446063051 +0000 UTC m=+258.309000748"
Sep 09 18:36:04.087443 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.087405    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"]
Sep 09 18:36:04.090841 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.090824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.093361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.093337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 18:36:04.093489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.093347    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srhxl\""
Sep 09 18:36:04.093751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.093732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 18:36:04.094384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.094363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 18:36:04.102111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.102094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"]
Sep 09 18:36:04.115601 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.115581    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcpwq"]
Sep 09 18:36:04.118597 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.118583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.121112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.121084    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 18:36:04.121112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.121097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 18:36:04.121260 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.121130    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 18:36:04.121260 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.121136    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rcsch\""
Sep 09 18:36:04.208221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.208221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.208420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-sys\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-root\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-wtmp\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5fr\" (UniqueName: \"kubernetes.io/projected/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-api-access-sz5fr\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ng5k\" (UniqueName: \"kubernetes.io/projected/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-kube-api-access-5ng5k\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-metrics-client-ca\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-textfile\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.208633 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.208614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309004 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.308959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309004 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-metrics-client-ca\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-textfile\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309243 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:36:04.309231    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:36:04.309308    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls podName:c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8 nodeName:}" failed. No retries permitted until 2026-09-09 18:36:04.809286277 +0000 UTC m=+260.672223967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls") pod "node-exporter-kcpwq" (UID: "c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8") : secret "node-exporter-tls" not found
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-sys\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-textfile\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-root\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-wtmp\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-sys\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-root\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5fr\" (UniqueName: \"kubernetes.io/projected/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-api-access-sz5fr\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309679    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-metrics-client-ca\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ng5k\" (UniqueName: \"kubernetes.io/projected/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-kube-api-access-5ng5k\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-wtmp\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.309985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.309829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.310326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.310304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.310405 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.310336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.310487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.310465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.311760 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.311741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.312038 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.312020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.312087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.312063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.320090 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.320063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5fr\" (UniqueName: \"kubernetes.io/projected/afea8ff0-b4d4-4ad3-b128-f0d56c36090a-kube-api-access-sz5fr\") pod \"kube-state-metrics-74cb57df7-ps5zx\" (UID: \"afea8ff0-b4d4-4ad3-b128-f0d56c36090a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.321136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.321104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ng5k\" (UniqueName: \"kubernetes.io/projected/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-kube-api-access-5ng5k\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.400695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.400657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"
Sep 09 18:36:04.672325 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.672267    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx"]
Sep 09 18:36:04.674710 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:04.674684    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafea8ff0_b4d4_4ad3_b128_f0d56c36090a.slice/crio-67be0243443956d3f1fad80badb800815700e36a9c46ac4af21a3e71eb456600 WatchSource:0}: Error finding container 67be0243443956d3f1fad80badb800815700e36a9c46ac4af21a3e71eb456600: Status 404 returned error can't find the container with id 67be0243443956d3f1fad80badb800815700e36a9c46ac4af21a3e71eb456600
Sep 09 18:36:04.813134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.813098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:04.815334 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:04.815305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8-node-exporter-tls\") pod \"node-exporter-kcpwq\" (UID: \"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8\") " pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:05.027190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:05.027109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcpwq"
Sep 09 18:36:05.039079 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:05.039050    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b1e48a_f3c7_4cf0_a52a_0ded72ff77c8.slice/crio-e1578b86d26c95d9e3ef690a4ac80629eeae98e24be752fdbaa546a662a47199 WatchSource:0}: Error finding container e1578b86d26c95d9e3ef690a4ac80629eeae98e24be752fdbaa546a662a47199: Status 404 returned error can't find the container with id e1578b86d26c95d9e3ef690a4ac80629eeae98e24be752fdbaa546a662a47199
Sep 09 18:36:05.443293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:05.443255    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcpwq" event={"ID":"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8","Type":"ContainerStarted","Data":"e1578b86d26c95d9e3ef690a4ac80629eeae98e24be752fdbaa546a662a47199"}
Sep 09 18:36:05.444494 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:05.444472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx" event={"ID":"afea8ff0-b4d4-4ad3-b128-f0d56c36090a","Type":"ContainerStarted","Data":"67be0243443956d3f1fad80badb800815700e36a9c46ac4af21a3e71eb456600"}
Sep 09 18:36:06.069641 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.069609    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"]
Sep 09 18:36:06.072773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.072752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.075056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 18:36:06.075056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075040    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 18:36:06.075056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6bnsbnqj14l7c\""
Sep 09 18:36:06.075268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075045    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 18:36:06.075268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075062    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 18:36:06.075382 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d86bs\""
Sep 09 18:36:06.075460 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.075371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 18:36:06.087850 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.085639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"]
Sep 09 18:36:06.125263 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-grpc-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125360 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125360 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125541 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-metrics-client-ca\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgc2\" (UniqueName: \"kubernetes.io/projected/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-kube-api-access-qzgc2\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.125685 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.125652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226219 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-grpc-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226219 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226557 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-metrics-client-ca\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226605 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgc2\" (UniqueName: \"kubernetes.io/projected/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-kube-api-access-qzgc2\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226654 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.226654 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.226634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.227368 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.227308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-metrics-client-ca\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229303    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-grpc-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229516 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229516 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229345    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229704 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.229885 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.229866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-secret-thanos-querier-tls\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.233716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.233689    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgc2\" (UniqueName: \"kubernetes.io/projected/ebb9d02b-2109-42c5-b6e0-f300ff5d65cf-kube-api-access-qzgc2\") pod \"thanos-querier-8f5f595c4-dzxvd\" (UID: \"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf\") " pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.383160 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.383069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:06.450762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.450728    2561 generic.go:356] "Generic (PLEG): container finished" podID="c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8" containerID="cdb5cf927a9c43250f4a9fe77b7b4c3c6d69a8fc1aaae75518fe2415c883dc81" exitCode=0
Sep 09 18:36:06.451132 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.450811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcpwq" event={"ID":"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8","Type":"ContainerDied","Data":"cdb5cf927a9c43250f4a9fe77b7b4c3c6d69a8fc1aaae75518fe2415c883dc81"}
Sep 09 18:36:06.654626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:06.654602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"]
Sep 09 18:36:06.656589 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:06.656563    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb9d02b_2109_42c5_b6e0_f300ff5d65cf.slice/crio-4e5753dd3bffd637b704b2e460584ebab93fa84be9edf20df330d62bc5e01485 WatchSource:0}: Error finding container 4e5753dd3bffd637b704b2e460584ebab93fa84be9edf20df330d62bc5e01485: Status 404 returned error can't find the container with id 4e5753dd3bffd637b704b2e460584ebab93fa84be9edf20df330d62bc5e01485
Sep 09 18:36:07.458009 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:07.457967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcpwq" event={"ID":"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8","Type":"ContainerStarted","Data":"66e65aa03cff91e11c7f5fa597a21870b618ffe515a53ab6d1cac76d304b06ec"}
Sep 09 18:36:07.458484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:07.458024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcpwq" event={"ID":"c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8","Type":"ContainerStarted","Data":"c2bd546868b1cd5ba4b2bd08499454bf386a00e513b1eaadc79b8de405fcf124"}
Sep 09 18:36:07.460098 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:07.460063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"4e5753dd3bffd637b704b2e460584ebab93fa84be9edf20df330d62bc5e01485"}
Sep 09 18:36:07.476813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:07.476762    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcpwq" podStartSLOduration=2.350960598 podStartE2EDuration="3.476746533s" totalImagesPullingTime="1.062980324s" totalInitContainerRuntime="62.805611ms" isStatefulPod=true podCreationTimestamp="2026-09-09 18:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:07.476089426 +0000 UTC m=+263.339027136" watchObservedRunningTime="2026-09-09 18:36:07.476746533 +0000 UTC m=+263.339684228"
Sep 09 18:36:08.860123 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.860093    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"]
Sep 09 18:36:08.863655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.863633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:08.865640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.865618    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 18:36:08.865728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.865625    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lv4v8\""
Sep 09 18:36:08.869864 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.869835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"]
Sep 09 18:36:08.949970 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.949878    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:08.950111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:08.950001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nscg\" (UniqueName: \"kubernetes.io/projected/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-kube-api-access-7nscg\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.051020 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.050985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.051173 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.051064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nscg\" (UniqueName: \"kubernetes.io/projected/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-kube-api-access-7nscg\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.053442 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.053412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.058458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.058436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nscg\" (UniqueName: \"kubernetes.io/projected/79ac1a8c-a3e2-437a-bec2-52d9cec59c2c-kube-api-access-7nscg\") pod \"monitoring-plugin-85bbbbbf4-trwk7\" (UID: \"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.175469 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.175430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:09.440975 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.440936    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"]
Sep 09 18:36:09.443924 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:09.443889    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ac1a8c_a3e2_437a_bec2_52d9cec59c2c.slice/crio-f3e334e6b257dacd619341e1c4f90f15592dd572f770eaf104d591e2ea3b037d WatchSource:0}: Error finding container f3e334e6b257dacd619341e1c4f90f15592dd572f770eaf104d591e2ea3b037d: Status 404 returned error can't find the container with id f3e334e6b257dacd619341e1c4f90f15592dd572f770eaf104d591e2ea3b037d
Sep 09 18:36:09.476240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.476161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"dd596e13c5272eb0a69051f7a0965a11b069aa5b384de45b51c2b7ad2c8057a9"}
Sep 09 18:36:09.476412 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.476269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"0ec900c32ea044f3f0baca5cf9d780853f3506d6e4ec691f109a3a38319c4455"}
Sep 09 18:36:09.476412 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.476307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"de665e49d67c74591e001541394f97a1beef4de51b19d90af8169be79de859e3"}
Sep 09 18:36:09.477531 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:09.477506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7" event={"ID":"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c","Type":"ContainerStarted","Data":"f3e334e6b257dacd619341e1c4f90f15592dd572f770eaf104d591e2ea3b037d"}
Sep 09 18:36:10.242030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.242000    2561 patch_prober.go:28] interesting pod/image-registry-7f9c77bfb7-scp7l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 18:36:10.242439 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.242152    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 18:36:10.488618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.487788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx" event={"ID":"afea8ff0-b4d4-4ad3-b128-f0d56c36090a","Type":"ContainerStarted","Data":"6de6df5782ff7fc6f5cf3625267e0095d4ae3cc814fd54110c0bd134822c92ce"}
Sep 09 18:36:10.488618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.487860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx" event={"ID":"afea8ff0-b4d4-4ad3-b128-f0d56c36090a","Type":"ContainerStarted","Data":"a6c2d21790e896d452b8b768681ff4a89ae4eece5a29d1eadc849ba5f2c65c3f"}
Sep 09 18:36:10.488618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.487886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx" event={"ID":"afea8ff0-b4d4-4ad3-b128-f0d56c36090a","Type":"ContainerStarted","Data":"f99121475e9d0dd7923cb74c86a77f247508e182de5b66d8cc851644ed2ad8a5"}
Sep 09 18:36:10.493799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.493764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"941e2dd2a1799439634e9501009ab53748cab934626f059de86c5efe1540f80d"}
Sep 09 18:36:10.493963 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.493834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"c8fd167c4e86be31ccd87616d89ac065396c6a595051e34f8f0be8a357f49380"}
Sep 09 18:36:10.493963 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.493880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" event={"ID":"ebb9d02b-2109-42c5-b6e0-f300ff5d65cf","Type":"ContainerStarted","Data":"a721ac5c33e5d6d9c357b2bd50a9f57ac2561b53e7fdaf68f9bce245d9637607"}
Sep 09 18:36:10.494182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.494156    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:10.509467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.509416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ps5zx" podStartSLOduration=1.026487101 podStartE2EDuration="6.509387326s" totalImagesPullingTime="5.482900225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:10.507836921 +0000 UTC m=+266.370774827" watchObservedRunningTime="2026-09-09 18:36:10.509387326 +0000 UTC m=+266.372325024"
Sep 09 18:36:10.530814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:10.530748    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd" podStartSLOduration=1.212889032 podStartE2EDuration="4.530725597s" totalImagesPullingTime="3.317836565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:10.528722846 +0000 UTC m=+266.391660545" watchObservedRunningTime="2026-09-09 18:36:10.530725597 +0000 UTC m=+266.393663296"
Sep 09 18:36:12.506694 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:12.506658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7" event={"ID":"79ac1a8c-a3e2-437a-bec2-52d9cec59c2c","Type":"ContainerStarted","Data":"4d0af4bea5776684ee6f72efb7998ba264693990231e5ada1e1ffc5e1c4779ba"}
Sep 09 18:36:12.507081 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:12.506813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:12.511535 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:12.511512    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7"
Sep 09 18:36:12.521702 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:12.521657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-trwk7" podStartSLOduration=2.360942164 podStartE2EDuration="4.521643277s" totalImagesPullingTime="2.160701113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:12.520469886 +0000 UTC m=+268.383407602" watchObservedRunningTime="2026-09-09 18:36:12.521643277 +0000 UTC m=+268.384580975"
Sep 09 18:36:15.253717 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.253665    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry" containerID="cri-o://8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52" gracePeriod=30
Sep 09 18:36:15.501509 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.501480    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:36:15.525623 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.525530    2561 generic.go:356] "Generic (PLEG): container finished" podID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerID="8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52" exitCode=0
Sep 09 18:36:15.525623 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.525580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" event={"ID":"e754f949-5ec3-43be-b332-fe93d8b6175c","Type":"ContainerDied","Data":"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"}
Sep 09 18:36:15.525623 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.525616    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l"
Sep 09 18:36:15.525872 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.525648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9c77bfb7-scp7l" event={"ID":"e754f949-5ec3-43be-b332-fe93d8b6175c","Type":"ContainerDied","Data":"45883c37a4e50ae9ebc307177063f35645c8c1c1d3864184b952f8285e929735"}
Sep 09 18:36:15.525872 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.525676    2561 scope.go:117] "RemoveContainer" containerID="8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"
Sep 09 18:36:15.536995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.536975    2561 scope.go:117] "RemoveContainer" containerID="8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"
Sep 09 18:36:15.537342 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:36:15.537317    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52\": container with ID starting with 8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52 not found: ID does not exist" containerID="8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"
Sep 09 18:36:15.537416 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.537352    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52"} err="failed to get container status \"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52\": rpc error: code = NotFound desc = could not find container \"8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52\": container with ID starting with 8e77025551ce74f617f214fa6f7b69d6827aebc745a9170ffea5b35d581d2c52 not found: ID does not exist"
Sep 09 18:36:15.604888 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.604856    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.604900    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.604928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.604968    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.604995    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.605033    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605254 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.605076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605254 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.605115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5xpc\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc\") pod \"e754f949-5ec3-43be-b332-fe93d8b6175c\" (UID: \"e754f949-5ec3-43be-b332-fe93d8b6175c\") "
Sep 09 18:36:15.605506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.605472    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:36:15.605694 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.605525    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:36:15.607417 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.607376    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:36:15.607660 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.607636    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc" (OuterVolumeSpecName: "kube-api-access-s5xpc") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "kube-api-access-s5xpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:36:15.607960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.607936    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:36:15.608032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.607964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:36:15.608032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.607998    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:36:15.614930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.614903    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e754f949-5ec3-43be-b332-fe93d8b6175c" (UID: "e754f949-5ec3-43be-b332-fe93d8b6175c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:36:15.706353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706306    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-bound-sa-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706348    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-image-registry-private-configuration\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706359    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5xpc\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-kube-api-access-s5xpc\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706371    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-trusted-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706380    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-tls\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706388    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e754f949-5ec3-43be-b332-fe93d8b6175c-ca-trust-extracted\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706416    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e754f949-5ec3-43be-b332-fe93d8b6175c-installation-pull-secrets\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.706626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.706424    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e754f949-5ec3-43be-b332-fe93d8b6175c-registry-certificates\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:36:15.846580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.846549    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:36:15.850033 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:15.850009    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f9c77bfb7-scp7l"]
Sep 09 18:36:16.352201 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.352167    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-2c2qw"]
Sep 09 18:36:16.352607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.352483    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry"
Sep 09 18:36:16.352607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.352497    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry"
Sep 09 18:36:16.352607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.352546    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" containerName="registry"
Sep 09 18:36:16.357088 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.357069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:16.359161 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.359136    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 18:36:16.359265 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.359137    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fqm47\""
Sep 09 18:36:16.359265 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.359194    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 18:36:16.363835 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.363809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-2c2qw"]
Sep 09 18:36:16.509010 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.508978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8f5f595c4-dzxvd"
Sep 09 18:36:16.512604 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.512573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5z8\" (UniqueName: \"kubernetes.io/projected/9e508a44-1510-4022-9712-11890a199862-kube-api-access-tw5z8\") pod \"downloads-85d98c998f-2c2qw\" (UID: \"9e508a44-1510-4022-9712-11890a199862\") " pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:16.607709 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.607631    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e754f949-5ec3-43be-b332-fe93d8b6175c" path="/var/lib/kubelet/pods/e754f949-5ec3-43be-b332-fe93d8b6175c/volumes"
Sep 09 18:36:16.613070 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.613038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5z8\" (UniqueName: \"kubernetes.io/projected/9e508a44-1510-4022-9712-11890a199862-kube-api-access-tw5z8\") pod \"downloads-85d98c998f-2c2qw\" (UID: \"9e508a44-1510-4022-9712-11890a199862\") " pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:16.620617 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.620591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5z8\" (UniqueName: \"kubernetes.io/projected/9e508a44-1510-4022-9712-11890a199862-kube-api-access-tw5z8\") pod \"downloads-85d98c998f-2c2qw\" (UID: \"9e508a44-1510-4022-9712-11890a199862\") " pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:16.666890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.666856    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:16.936894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:16.936859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-2c2qw"]
Sep 09 18:36:16.939898 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:16.939868    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e508a44_1510_4022_9712_11890a199862.slice/crio-3c0d385acfd2543b161f796a0beac88c38ae2e8f4f1f15ee807365c170a4206a WatchSource:0}: Error finding container 3c0d385acfd2543b161f796a0beac88c38ae2e8f4f1f15ee807365c170a4206a: Status 404 returned error can't find the container with id 3c0d385acfd2543b161f796a0beac88c38ae2e8f4f1f15ee807365c170a4206a
Sep 09 18:36:17.537006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:17.536972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-2c2qw" event={"ID":"9e508a44-1510-4022-9712-11890a199862","Type":"ContainerStarted","Data":"3c0d385acfd2543b161f796a0beac88c38ae2e8f4f1f15ee807365c170a4206a"}
Sep 09 18:36:26.141126 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:36:26.141084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvm87" podUID="94a3c247-eaee-4be8-994b-d9b4204eaca5"
Sep 09 18:36:26.260049 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.260013    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:36:26.267542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.267514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.269960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.269930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 18:36:26.269960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.269952    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 18:36:26.270631 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.270607    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 18:36:26.270748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.270636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 18:36:26.270939 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.270920    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qkn6x\""
Sep 09 18:36:26.271022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.270953    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 18:36:26.273426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.273380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:36:26.397999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.397907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.397999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.397958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.398232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.398007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.398232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.398101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfxv\" (UniqueName: \"kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.398232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.398162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.398232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.398187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfxv\" (UniqueName: \"kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.499384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.500078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.499986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.500078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.500042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.500459 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.500437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.502169 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.502121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.502277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.502196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.507958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.507932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfxv\" (UniqueName: \"kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv\") pod \"console-8466d4b8bf-g8q8k\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") " pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.574043 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.574015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:26.579451 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.579421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:26.857917 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:26.857872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:36:26.860540 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:26.860508    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a915cdb_6d78_4cdc_9374_52e342542596.slice/crio-f2aab9bd56b5b7778c27bc9907476cac4679b72e0fea971f6ff4e261b5a5116c WatchSource:0}: Error finding container f2aab9bd56b5b7778c27bc9907476cac4679b72e0fea971f6ff4e261b5a5116c: Status 404 returned error can't find the container with id f2aab9bd56b5b7778c27bc9907476cac4679b72e0fea971f6ff4e261b5a5116c
Sep 09 18:36:27.578445 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:27.578412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8466d4b8bf-g8q8k" event={"ID":"4a915cdb-6d78-4cdc-9374-52e342542596","Type":"ContainerStarted","Data":"f2aab9bd56b5b7778c27bc9907476cac4679b72e0fea971f6ff4e261b5a5116c"}
Sep 09 18:36:29.324009 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:29.323962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:29.326601 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:29.326570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94a3c247-eaee-4be8-994b-d9b4204eaca5-metrics-tls\") pod \"dns-default-gvm87\" (UID: \"94a3c247-eaee-4be8-994b-d9b4204eaca5\") " pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:29.577626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:29.577547    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dgjhb\""
Sep 09 18:36:29.585840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:29.585809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:34.649212 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.649178    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:36:34.658040 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.658003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.661600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.661570    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:36:34.665903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.665879    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 18:36:34.772378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42cs\" (UniqueName: \"kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.772573 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.772542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873211 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42cs\" (UniqueName: \"kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.873427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.873406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.874171 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.874142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.874293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.874181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.874293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.874231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.874425 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.874346    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.876418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.876378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.876533 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.876516    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.881198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.881179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42cs\" (UniqueName: \"kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs\") pod \"console-766489b4bc-cx6b6\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") " pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:34.970553 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:34.970464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:35.612058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.612019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-2c2qw" event={"ID":"9e508a44-1510-4022-9712-11890a199862","Type":"ContainerStarted","Data":"eee8aa76ac2ac9eb28c56e9ae2d69e3a2c47255a0984ebcbf95f4ff534c6fd93"}
Sep 09 18:36:35.612209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.612083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:35.613716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.613693    2561 generic.go:356] "Generic (PLEG): container finished" podID="2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275" containerID="11093719a9f62c7ae368c49aa095341295f29528e270fdd3f5c6f37f19f6fd8c" exitCode=0
Sep 09 18:36:35.613817 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.613730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn" event={"ID":"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275","Type":"ContainerDied","Data":"11093719a9f62c7ae368c49aa095341295f29528e270fdd3f5c6f37f19f6fd8c"}
Sep 09 18:36:35.613817 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.613800    2561 patch_prober.go:28] interesting pod/downloads-85d98c998f-2c2qw container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused" start-of-body=
Sep 09 18:36:35.613884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.613844    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-2c2qw" podUID="9e508a44-1510-4022-9712-11890a199862" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 09 18:36:35.614027 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.614012    2561 scope.go:117] "RemoveContainer" containerID="11093719a9f62c7ae368c49aa095341295f29528e270fdd3f5c6f37f19f6fd8c"
Sep 09 18:36:35.629089 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.629049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-2c2qw" podStartSLOduration=1.055009302 podStartE2EDuration="19.62903111s" totalImagesPullingTime="18.574021808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:35.627698241 +0000 UTC m=+291.490635958" watchObservedRunningTime="2026-09-09 18:36:35.62903111 +0000 UTC m=+291.491968856"
Sep 09 18:36:35.721435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.719516    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:36:35.726411 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:35.726184    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b05f06_6e76_48ad_a518_0c339681e699.slice/crio-d8fb5ba2253c733d0061542f09dda5dbd8894cc7f7bb7de82a5458fe3fbfe979 WatchSource:0}: Error finding container d8fb5ba2253c733d0061542f09dda5dbd8894cc7f7bb7de82a5458fe3fbfe979: Status 404 returned error can't find the container with id d8fb5ba2253c733d0061542f09dda5dbd8894cc7f7bb7de82a5458fe3fbfe979
Sep 09 18:36:35.744818 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:35.744690    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvm87"]
Sep 09 18:36:35.749347 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:36:35.749319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a3c247_eaee_4be8_994b_d9b4204eaca5.slice/crio-2c61e2ae7c6fe2554206778d23bd0e7490052eb0c0f01c066749d495961236c7 WatchSource:0}: Error finding container 2c61e2ae7c6fe2554206778d23bd0e7490052eb0c0f01c066749d495961236c7: Status 404 returned error can't find the container with id 2c61e2ae7c6fe2554206778d23bd0e7490052eb0c0f01c066749d495961236c7
Sep 09 18:36:36.620763 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:36.620720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766489b4bc-cx6b6" event={"ID":"d0b05f06-6e76-48ad-a518-0c339681e699","Type":"ContainerStarted","Data":"d8fb5ba2253c733d0061542f09dda5dbd8894cc7f7bb7de82a5458fe3fbfe979"}
Sep 09 18:36:36.623588 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:36.623550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-58ntn" event={"ID":"2de0613f-d1cd-4b96-bd4e-b2fd4fcf6275","Type":"ContainerStarted","Data":"4559b2c4c21707e248288aa92936e82a33f34c46875623ae5871fb3e16ab6ce6"}
Sep 09 18:36:36.625820 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:36.625754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvm87" event={"ID":"94a3c247-eaee-4be8-994b-d9b4204eaca5","Type":"ContainerStarted","Data":"2c61e2ae7c6fe2554206778d23bd0e7490052eb0c0f01c066749d495961236c7"}
Sep 09 18:36:36.634318 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:36.634257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-2c2qw"
Sep 09 18:36:39.645001 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:39.644913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766489b4bc-cx6b6" event={"ID":"d0b05f06-6e76-48ad-a518-0c339681e699","Type":"ContainerStarted","Data":"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"}
Sep 09 18:36:39.648224 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:39.648127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8466d4b8bf-g8q8k" event={"ID":"4a915cdb-6d78-4cdc-9374-52e342542596","Type":"ContainerStarted","Data":"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"}
Sep 09 18:36:39.663895 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:39.663405    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766489b4bc-cx6b6" podStartSLOduration=1.894687517 podStartE2EDuration="5.663368872s" totalImagesPullingTime="3.768681355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:39.659917354 +0000 UTC m=+295.522855102" watchObservedRunningTime="2026-09-09 18:36:39.663368872 +0000 UTC m=+295.526306573"
Sep 09 18:36:39.676341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:39.676020    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8466d4b8bf-g8q8k" podStartSLOduration=1.427569434 podStartE2EDuration="13.675998645s" totalImagesPullingTime="12.248429211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:39.674339089 +0000 UTC m=+295.537276821" watchObservedRunningTime="2026-09-09 18:36:39.675998645 +0000 UTC m=+295.538936346"
Sep 09 18:36:41.664881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:41.664839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvm87" event={"ID":"94a3c247-eaee-4be8-994b-d9b4204eaca5","Type":"ContainerStarted","Data":"f0a523b7d6023645b55f3a8502dbded8df97360a68a5a0a6dfea1a754f07b0c6"}
Sep 09 18:36:41.665302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:41.664936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvm87" event={"ID":"94a3c247-eaee-4be8-994b-d9b4204eaca5","Type":"ContainerStarted","Data":"98f1770d6cf138a41e8a1bc8a212f66ab00daa1de8ad25058e250fdf503c7f3c"}
Sep 09 18:36:41.665302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:41.664964    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:41.682859 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:41.682805    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvm87" podStartSLOduration=257.382034154 podStartE2EDuration="4m22.682784979s" totalImagesPullingTime="5.300750825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:36:41.681151649 +0000 UTC m=+297.544089372" watchObservedRunningTime="2026-09-09 18:36:41.682784979 +0000 UTC m=+297.545722678"
Sep 09 18:36:44.515583 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.515555    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:36:44.516252 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.516220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:36:44.524083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.524061    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 18:36:44.971593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.971548    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:44.985103 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.971639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:44.985103 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:44.976186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:45.692371 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:45.692340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:36:45.739515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:45.739480    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:36:46.580006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:46.579957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:36:47.900759 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:47.900725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-state-metrics/0.log"
Sep 09 18:36:48.102937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.102904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-rbac-proxy-main/0.log"
Sep 09 18:36:48.301105 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.300998    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-rbac-proxy-self/0.log"
Sep 09 18:36:48.700276 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.700185    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-trwk7_79ac1a8c-a3e2-437a-bec2-52d9cec59c2c/monitoring-plugin/0.log"
Sep 09 18:36:48.701175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.701151    2561 generic.go:356] "Generic (PLEG): container finished" podID="ee2685f6-a07a-42f1-a55d-23aea8fed7d7" containerID="78a20c0d288f928ee7c417194d195afcd5e87bfc1a19c4172c90ccf6e3663cc6" exitCode=0
Sep 09 18:36:48.701290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.701221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2" event={"ID":"ee2685f6-a07a-42f1-a55d-23aea8fed7d7","Type":"ContainerDied","Data":"78a20c0d288f928ee7c417194d195afcd5e87bfc1a19c4172c90ccf6e3663cc6"}
Sep 09 18:36:48.701543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:48.701528    2561 scope.go:117] "RemoveContainer" containerID="78a20c0d288f928ee7c417194d195afcd5e87bfc1a19c4172c90ccf6e3663cc6"
Sep 09 18:36:49.500839 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:49.500803    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/init-textfile/0.log"
Sep 09 18:36:49.703290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:49.703258    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/node-exporter/0.log"
Sep 09 18:36:49.709279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:49.709248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-5dlf2" event={"ID":"ee2685f6-a07a-42f1-a55d-23aea8fed7d7","Type":"ContainerStarted","Data":"361d18c96f844626204a25bc45468771d0216359563ba36a52bd7011f9620fdb"}
Sep 09 18:36:49.900435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:49.900382    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/kube-rbac-proxy/0.log"
Sep 09 18:36:51.671225 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:51.671196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvm87"
Sep 09 18:36:52.702530 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:52.702495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fbh2c_e3e43b02-2817-46fe-8161-654073192a58/prometheus-operator/0.log"
Sep 09 18:36:52.901035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:52.900974    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fbh2c_e3e43b02-2817-46fe-8161-654073192a58/kube-rbac-proxy/0.log"
Sep 09 18:36:53.300840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:53.300809    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/thanos-query/0.log"
Sep 09 18:36:53.500050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:53.500020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-web/0.log"
Sep 09 18:36:53.700346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:53.700316    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy/0.log"
Sep 09 18:36:53.900624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:53.900593    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/prom-label-proxy/0.log"
Sep 09 18:36:54.100427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:54.100336    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-rules/0.log"
Sep 09 18:36:54.300899 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:54.300865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-metrics/0.log"
Sep 09 18:36:54.500282 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:54.500246    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-mhbxb_01e6558b-f477-40e3-8043-09390d741210/networking-console-plugin/0.log"
Sep 09 18:36:55.100935 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:55.100904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-766489b4bc-cx6b6_d0b05f06-6e76-48ad-a518-0c339681e699/console/0.log"
Sep 09 18:36:55.301050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:55.301026    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8466d4b8bf-g8q8k_4a915cdb-6d78-4cdc-9374-52e342542596/console/0.log"
Sep 09 18:36:55.503124 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:55.503088    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-2c2qw_9e508a44-1510-4022-9712-11890a199862/download-server/0.log"
Sep 09 18:36:55.700897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:55.700866    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvm87_94a3c247-eaee-4be8-994b-d9b4204eaca5/dns/0.log"
Sep 09 18:36:55.901250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:55.901218    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvm87_94a3c247-eaee-4be8-994b-d9b4204eaca5/kube-rbac-proxy/0.log"
Sep 09 18:36:57.300590 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:57.300557    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-td2tq_d02deed6-0ece-448a-af83-5a70d6cc352a/dns-node-resolver/0.log"
Sep 09 18:36:57.501551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:57.501522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d4ff4d8d-hs5d8_8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622/router/0.log"
Sep 09 18:36:57.900643 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:36:57.900608    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwtwz_92f504bd-303b-429e-b0fc-497f42a5d68d/serve-healthcheck-canary/0.log"
Sep 09 18:37:10.768937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:10.768866    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8466d4b8bf-g8q8k" podUID="4a915cdb-6d78-4cdc-9374-52e342542596" containerName="console" containerID="cri-o://76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf" gracePeriod=15
Sep 09 18:37:11.042175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.042103    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:37:11.164290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164251    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tfxv\" (UniqueName: \"kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164678 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164628    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert\") pod \"4a915cdb-6d78-4cdc-9374-52e342542596\" (UID: \"4a915cdb-6d78-4cdc-9374-52e342542596\") "
Sep 09 18:37:11.164787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164747    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config" (OuterVolumeSpecName: "console-config") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:37:11.164943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164920    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-console-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.165031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.164994    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:37:11.165093 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.165060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:37:11.166701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.166672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv" (OuterVolumeSpecName: "kube-api-access-5tfxv") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "kube-api-access-5tfxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:37:11.166800 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.166703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:37:11.166800 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.166763    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a915cdb-6d78-4cdc-9374-52e342542596" (UID: "4a915cdb-6d78-4cdc-9374-52e342542596"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:37:11.266333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.266293    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tfxv\" (UniqueName: \"kubernetes.io/projected/4a915cdb-6d78-4cdc-9374-52e342542596-kube-api-access-5tfxv\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.266333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.266327    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.266333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.266337    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a915cdb-6d78-4cdc-9374-52e342542596-oauth-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.266580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.266351    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.266580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.266371    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a915cdb-6d78-4cdc-9374-52e342542596-console-oauth-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:37:11.798602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.798566    2561 generic.go:356] "Generic (PLEG): container finished" podID="4a915cdb-6d78-4cdc-9374-52e342542596" containerID="76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf" exitCode=0
Sep 09 18:37:11.798999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.798616    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8466d4b8bf-g8q8k"
Sep 09 18:37:11.798999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.798653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8466d4b8bf-g8q8k" event={"ID":"4a915cdb-6d78-4cdc-9374-52e342542596","Type":"ContainerDied","Data":"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"}
Sep 09 18:37:11.798999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.798709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8466d4b8bf-g8q8k" event={"ID":"4a915cdb-6d78-4cdc-9374-52e342542596","Type":"ContainerDied","Data":"f2aab9bd56b5b7778c27bc9907476cac4679b72e0fea971f6ff4e261b5a5116c"}
Sep 09 18:37:11.798999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.798730    2561 scope.go:117] "RemoveContainer" containerID="76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"
Sep 09 18:37:11.807594 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.807578    2561 scope.go:117] "RemoveContainer" containerID="76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"
Sep 09 18:37:11.807839 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:37:11.807825    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf\": container with ID starting with 76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf not found: ID does not exist" containerID="76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"
Sep 09 18:37:11.807877 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.807845    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf"} err="failed to get container status \"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf\": rpc error: code = NotFound desc = could not find container \"76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf\": container with ID starting with 76ad808f3e76fc2ce7b19c9f78bc8eb69643a182e127db57a623062b9ef4bdaf not found: ID does not exist"
Sep 09 18:37:11.818707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.818683    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:37:11.823937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:11.823916    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8466d4b8bf-g8q8k"]
Sep 09 18:37:12.608267 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:12.608231    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a915cdb-6d78-4cdc-9374-52e342542596" path="/var/lib/kubelet/pods/4a915cdb-6d78-4cdc-9374-52e342542596/volumes"
Sep 09 18:37:31.706875 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.706841    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:37:31.707329 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.707145    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a915cdb-6d78-4cdc-9374-52e342542596" containerName="console"
Sep 09 18:37:31.707329 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.707156    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a915cdb-6d78-4cdc-9374-52e342542596" containerName="console"
Sep 09 18:37:31.707329 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.707203    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a915cdb-6d78-4cdc-9374-52e342542596" containerName="console"
Sep 09 18:37:31.709467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.709446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.720120 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.720094    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:37:31.830138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qnwd\" (UniqueName: \"kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.830361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.830345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931485 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qnwd\" (UniqueName: \"kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.931952 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.931754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.932353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.932319    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.932496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.932326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.932496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.932371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.932496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.932472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.934111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.934085    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.934205 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.934188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:31.938618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:31.938594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qnwd\" (UniqueName: \"kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd\") pod \"console-857dbdc85-7gq2r\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") " pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:32.018531 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:32.018441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:32.283799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:32.283776    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:37:32.286465 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:37:32.286435    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd7e2d9_c057_4e30_8230_b18aa6f14a5a.slice/crio-31e9c8debec5a52f65576ef1fbd182eb49ad09c5f8eacdf21fb80a7d85c9a9c7 WatchSource:0}: Error finding container 31e9c8debec5a52f65576ef1fbd182eb49ad09c5f8eacdf21fb80a7d85c9a9c7: Status 404 returned error can't find the container with id 31e9c8debec5a52f65576ef1fbd182eb49ad09c5f8eacdf21fb80a7d85c9a9c7
Sep 09 18:37:32.882783 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:32.882748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857dbdc85-7gq2r" event={"ID":"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a","Type":"ContainerStarted","Data":"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"}
Sep 09 18:37:32.883162 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:32.882801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857dbdc85-7gq2r" event={"ID":"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a","Type":"ContainerStarted","Data":"31e9c8debec5a52f65576ef1fbd182eb49ad09c5f8eacdf21fb80a7d85c9a9c7"}
Sep 09 18:37:32.900643 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:32.900587    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-857dbdc85-7gq2r" podStartSLOduration=1.900544451 podStartE2EDuration="1.900544451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:37:32.899630784 +0000 UTC m=+348.762568499" watchObservedRunningTime="2026-09-09 18:37:32.900544451 +0000 UTC m=+348.763482149"
Sep 09 18:37:42.018974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:42.018875    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:42.018974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:42.018957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:42.023778 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:42.023757    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:42.924581 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:42.924550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:37:42.967135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:37:42.967097    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:38:07.990512 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:07.990443    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-766489b4bc-cx6b6" podUID="d0b05f06-6e76-48ad-a518-0c339681e699" containerName="console" containerID="cri-o://cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db" gracePeriod=15
Sep 09 18:38:08.224549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.224524    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:38:08.325823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325737    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.325823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.325823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325795    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.325823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325820    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.326144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325860    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.326144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325879    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.326144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.325905    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g42cs\" (UniqueName: \"kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs\") pod \"d0b05f06-6e76-48ad-a518-0c339681e699\" (UID: \"d0b05f06-6e76-48ad-a518-0c339681e699\") "
Sep 09 18:38:08.326324 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.326291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config" (OuterVolumeSpecName: "console-config") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:38:08.326385 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.326361    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:38:08.326467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.326377    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:38:08.326467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.326458    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:38:08.328073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.328043    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:38:08.328189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.328090    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:38:08.328189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.328106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs" (OuterVolumeSpecName: "kube-api-access-g42cs") pod "d0b05f06-6e76-48ad-a518-0c339681e699" (UID: "d0b05f06-6e76-48ad-a518-0c339681e699"). InnerVolumeSpecName "kube-api-access-g42cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:38:08.427335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427284    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-console-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427325    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427334    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b05f06-6e76-48ad-a518-0c339681e699-console-oauth-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427345    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-trusted-ca-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427354    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427364    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b05f06-6e76-48ad-a518-0c339681e699-oauth-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:08.427655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:08.427372    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g42cs\" (UniqueName: \"kubernetes.io/projected/d0b05f06-6e76-48ad-a518-0c339681e699-kube-api-access-g42cs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:38:09.017598 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.017561    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b05f06-6e76-48ad-a518-0c339681e699" containerID="cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db" exitCode=0
Sep 09 18:38:09.018024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.017615    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766489b4bc-cx6b6"
Sep 09 18:38:09.018024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.017647    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766489b4bc-cx6b6" event={"ID":"d0b05f06-6e76-48ad-a518-0c339681e699","Type":"ContainerDied","Data":"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"}
Sep 09 18:38:09.018024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.017705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766489b4bc-cx6b6" event={"ID":"d0b05f06-6e76-48ad-a518-0c339681e699","Type":"ContainerDied","Data":"d8fb5ba2253c733d0061542f09dda5dbd8894cc7f7bb7de82a5458fe3fbfe979"}
Sep 09 18:38:09.018024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.017726    2561 scope.go:117] "RemoveContainer" containerID="cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"
Sep 09 18:38:09.025586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.025518    2561 scope.go:117] "RemoveContainer" containerID="cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"
Sep 09 18:38:09.025807 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:38:09.025788    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db\": container with ID starting with cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db not found: ID does not exist" containerID="cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"
Sep 09 18:38:09.025866 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.025816    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db"} err="failed to get container status \"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db\": rpc error: code = NotFound desc = could not find container \"cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db\": container with ID starting with cbe5d5c6d6a967c74782fce3e61965f652ec359e9286f6177af7fa73527875db not found: ID does not exist"
Sep 09 18:38:09.032589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.032563    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:38:09.034315 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:09.034296    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766489b4bc-cx6b6"]
Sep 09 18:38:10.611273 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:10.608288    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b05f06-6e76-48ad-a518-0c339681e699" path="/var/lib/kubelet/pods/d0b05f06-6e76-48ad-a518-0c339681e699/volumes"
Sep 09 18:38:40.255610 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.255570    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:38:40.256104 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.255858    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b05f06-6e76-48ad-a518-0c339681e699" containerName="console"
Sep 09 18:38:40.256104 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.255869    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b05f06-6e76-48ad-a518-0c339681e699" containerName="console"
Sep 09 18:38:40.256104 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.255930    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b05f06-6e76-48ad-a518-0c339681e699" containerName="console"
Sep 09 18:38:40.257587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.257570    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.274087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.274063    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:38:40.279968 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.279947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbpt\" (UniqueName: \"kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.279978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.279996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.280013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.280121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.280173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.280240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.280201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381462 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbpt\" (UniqueName: \"kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.381934 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.381673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.382355 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.382329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.382476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.382423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.382476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.382456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.382880 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.382860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.384195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.384159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.384337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.384321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.389159 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.389137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbpt\" (UniqueName: \"kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt\") pod \"console-6df99bfd75-6djts\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") " pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.567510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.567408    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:40.834511 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:40.834310    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:38:40.837103 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:38:40.837075    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb51b701_ffca_42c2_aa60_c3a35d5b9b50.slice/crio-0dbe654dea5ad43459c83948ee59c66fc534a45ffb1759a197038424aa3837a1 WatchSource:0}: Error finding container 0dbe654dea5ad43459c83948ee59c66fc534a45ffb1759a197038424aa3837a1: Status 404 returned error can't find the container with id 0dbe654dea5ad43459c83948ee59c66fc534a45ffb1759a197038424aa3837a1
Sep 09 18:38:41.140717 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:41.140628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df99bfd75-6djts" event={"ID":"fb51b701-ffca-42c2-aa60-c3a35d5b9b50","Type":"ContainerStarted","Data":"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"}
Sep 09 18:38:41.140717 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:41.140680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df99bfd75-6djts" event={"ID":"fb51b701-ffca-42c2-aa60-c3a35d5b9b50","Type":"ContainerStarted","Data":"0dbe654dea5ad43459c83948ee59c66fc534a45ffb1759a197038424aa3837a1"}
Sep 09 18:38:41.156787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:41.156740    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df99bfd75-6djts" podStartSLOduration=1.156720943 podStartE2EDuration="1.156720943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:38:41.155711066 +0000 UTC m=+417.018648789" watchObservedRunningTime="2026-09-09 18:38:41.156720943 +0000 UTC m=+417.019658641"
Sep 09 18:38:50.568031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:50.567976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:50.568513 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:50.568075    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:50.572897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:50.572870    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:51.181802 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:51.181775    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:38:51.225147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:38:51.225114    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:39:16.248230 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.248139    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-857dbdc85-7gq2r" podUID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" containerName="console" containerID="cri-o://2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416" gracePeriod=15
Sep 09 18:39:16.479405 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.479365    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:39:16.562913 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.562913 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562859    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.562913 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.563192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qnwd\" (UniqueName: \"kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.563192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562947    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.563192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562963    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.563192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.562988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca\") pod \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\" (UID: \"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a\") "
Sep 09 18:39:16.563422 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.563369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:39:16.563483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.563421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config" (OuterVolumeSpecName: "console-config") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:39:16.563483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.563442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:39:16.563680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.563649    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:39:16.565112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.565088    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:39:16.565192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.565134    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:39:16.565192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.565183    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd" (OuterVolumeSpecName: "kube-api-access-9qnwd") pod "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" (UID: "fdd7e2d9-c057-4e30-8230-b18aa6f14a5a"). InnerVolumeSpecName "kube-api-access-9qnwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:39:16.663867 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663826    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qnwd\" (UniqueName: \"kubernetes.io/projected/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-kube-api-access-9qnwd\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.663867 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663860    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.663867 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663871    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-oauth-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.664087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663881    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.664087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663890    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-oauth-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.664087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663898    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-trusted-ca-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:16.664087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:16.663906    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a-console-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:39:17.280418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.280363    2561 generic.go:356] "Generic (PLEG): container finished" podID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" containerID="2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416" exitCode=0
Sep 09 18:39:17.280879 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.280435    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857dbdc85-7gq2r"
Sep 09 18:39:17.280879 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.280449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857dbdc85-7gq2r" event={"ID":"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a","Type":"ContainerDied","Data":"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"}
Sep 09 18:39:17.280879 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.280502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857dbdc85-7gq2r" event={"ID":"fdd7e2d9-c057-4e30-8230-b18aa6f14a5a","Type":"ContainerDied","Data":"31e9c8debec5a52f65576ef1fbd182eb49ad09c5f8eacdf21fb80a7d85c9a9c7"}
Sep 09 18:39:17.280879 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.280523    2561 scope.go:117] "RemoveContainer" containerID="2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"
Sep 09 18:39:17.288322 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.288305    2561 scope.go:117] "RemoveContainer" containerID="2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"
Sep 09 18:39:17.288633 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:39:17.288604    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416\": container with ID starting with 2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416 not found: ID does not exist" containerID="2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"
Sep 09 18:39:17.288712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.288634    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416"} err="failed to get container status \"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416\": rpc error: code = NotFound desc = could not find container \"2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416\": container with ID starting with 2c4df671cc2f3b1d371fab290b8a8b277a3c97aeff3403b3c3e350eb9f384416 not found: ID does not exist"
Sep 09 18:39:17.295382 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.295359    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:39:17.297557 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:17.297536    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-857dbdc85-7gq2r"]
Sep 09 18:39:18.607379 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:18.607345    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" path="/var/lib/kubelet/pods/fdd7e2d9-c057-4e30-8230-b18aa6f14a5a/volumes"
Sep 09 18:39:54.767837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.767800    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"]
Sep 09 18:39:54.768321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.768095    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" containerName="console"
Sep 09 18:39:54.768321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.768107    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" containerName="console"
Sep 09 18:39:54.768321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.768155    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd7e2d9-c057-4e30-8230-b18aa6f14a5a" containerName="console"
Sep 09 18:39:54.772372 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.772354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.774675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.774647    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 18:39:54.774809 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.774740    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 18:39:54.774809 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.774753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxf5l\""
Sep 09 18:39:54.781007 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.780984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"]
Sep 09 18:39:54.860440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.860380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.860599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.860459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72mr\" (UniqueName: \"kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.860599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.860506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.961847 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.961808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.962016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.961881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72mr\" (UniqueName: \"kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.962016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.961912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.962158 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.962138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.962244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.962226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:54.970671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:54.970638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72mr\" (UniqueName: \"kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:55.082069 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:55.081962    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:39:55.353099 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:55.353029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"]
Sep 09 18:39:55.356447 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:39:55.356416    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7704dc_831e_47dc_bf8e_11ac0cc35f6d.slice/crio-53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe WatchSource:0}: Error finding container 53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe: Status 404 returned error can't find the container with id 53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe
Sep 09 18:39:55.358524 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:55.358509    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 18:39:55.425718 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:39:55.425676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs" event={"ID":"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d","Type":"ContainerStarted","Data":"53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe"}
Sep 09 18:40:06.470728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:06.470686    2561 generic.go:356] "Generic (PLEG): container finished" podID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerID="f90bfa558636bb96ffb4ea659b578f211fac2a229ce2aef6264b60a22ca76f66" exitCode=0
Sep 09 18:40:06.471261 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:06.470788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs" event={"ID":"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d","Type":"ContainerDied","Data":"f90bfa558636bb96ffb4ea659b578f211fac2a229ce2aef6264b60a22ca76f66"}
Sep 09 18:40:12.500963 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:12.500906    2561 generic.go:356] "Generic (PLEG): container finished" podID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerID="3438c3679bdd075e07b0ce259d7f0e916dd6336a9d216d167b721edc6637983a" exitCode=0
Sep 09 18:40:12.501494 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:12.500999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs" event={"ID":"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d","Type":"ContainerDied","Data":"3438c3679bdd075e07b0ce259d7f0e916dd6336a9d216d167b721edc6637983a"}
Sep 09 18:40:20.535624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:20.535584    2561 generic.go:356] "Generic (PLEG): container finished" podID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerID="ecfc4ef6ddd572f202c306d5336a796869065bc5d5a015a159852f9990e180c5" exitCode=0
Sep 09 18:40:20.536071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:20.535674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs" event={"ID":"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d","Type":"ContainerDied","Data":"ecfc4ef6ddd572f202c306d5336a796869065bc5d5a015a159852f9990e180c5"}
Sep 09 18:40:21.706648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.706613    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:40:21.794259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.794170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util\") pod \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") "
Sep 09 18:40:21.794259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.794220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s72mr\" (UniqueName: \"kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr\") pod \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") "
Sep 09 18:40:21.794259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.794241    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle\") pod \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\" (UID: \"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d\") "
Sep 09 18:40:21.794867 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.794842    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle" (OuterVolumeSpecName: "bundle") pod "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" (UID: "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:21.796557 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.796525    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr" (OuterVolumeSpecName: "kube-api-access-s72mr") pod "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" (UID: "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d"). InnerVolumeSpecName "kube-api-access-s72mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:40:21.798367 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.798347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util" (OuterVolumeSpecName: "util") pod "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" (UID: "0d7704dc-831e-47dc-bf8e-11ac0cc35f6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:21.895417 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.895361    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:21.895417 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.895413    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s72mr\" (UniqueName: \"kubernetes.io/projected/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-kube-api-access-s72mr\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:21.895417 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:21.895425    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7704dc-831e-47dc-bf8e-11ac0cc35f6d-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:22.545439 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:22.545410    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs"
Sep 09 18:40:22.545649 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:22.545386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cvhxs" event={"ID":"0d7704dc-831e-47dc-bf8e-11ac0cc35f6d","Type":"ContainerDied","Data":"53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe"}
Sep 09 18:40:22.545649 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:22.545525    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d136cdbd49218323694272cd26d3327d1621de946ec3815958f1b973e83efe"
Sep 09 18:40:28.016051 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016014    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"]
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016303    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="extract"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016315    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="extract"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016334    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="pull"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016339    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="pull"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016350    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="util"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016355    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="util"
Sep 09 18:40:28.016550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.016414    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7704dc-831e-47dc-bf8e-11ac0cc35f6d" containerName="extract"
Sep 09 18:40:28.018165 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.018148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.020622 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.020601    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-th7cg\""
Sep 09 18:40:28.020757 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.020734    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 18:40:28.020819 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.020739    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:40:28.032108 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.032081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"]
Sep 09 18:40:28.146099 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.146054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvt5\" (UniqueName: \"kubernetes.io/projected/ad7035af-19dc-4192-beec-75358e413602-kube-api-access-7jvt5\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.146277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.146125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad7035af-19dc-4192-beec-75358e413602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.246650 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.246611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvt5\" (UniqueName: \"kubernetes.io/projected/ad7035af-19dc-4192-beec-75358e413602-kube-api-access-7jvt5\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.246817 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.246665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad7035af-19dc-4192-beec-75358e413602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.246990 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.246975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad7035af-19dc-4192-beec-75358e413602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.255430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.255386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvt5\" (UniqueName: \"kubernetes.io/projected/ad7035af-19dc-4192-beec-75358e413602-kube-api-access-7jvt5\") pod \"cert-manager-operator-controller-manager-55c444bf86-hcqm6\" (UID: \"ad7035af-19dc-4192-beec-75358e413602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.327467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.327343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"
Sep 09 18:40:28.617513 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:28.617417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6"]
Sep 09 18:40:28.621587 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:28.621559    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7035af_19dc_4192_beec_75358e413602.slice/crio-0d4ea7776648145e8b9b0df55801ef72103ab3be3a450b803458fb397a79cc8a WatchSource:0}: Error finding container 0d4ea7776648145e8b9b0df55801ef72103ab3be3a450b803458fb397a79cc8a: Status 404 returned error can't find the container with id 0d4ea7776648145e8b9b0df55801ef72103ab3be3a450b803458fb397a79cc8a
Sep 09 18:40:29.573490 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:29.573450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6" event={"ID":"ad7035af-19dc-4192-beec-75358e413602","Type":"ContainerStarted","Data":"0d4ea7776648145e8b9b0df55801ef72103ab3be3a450b803458fb397a79cc8a"}
Sep 09 18:40:33.593112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:33.593010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6" event={"ID":"ad7035af-19dc-4192-beec-75358e413602","Type":"ContainerStarted","Data":"95927d040dca030f0f61bcab0c2d541a7b5e7546bbbff4b66cb08c36299a6e55"}
Sep 09 18:40:33.617326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:33.617265    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hcqm6" podStartSLOduration=1.9671252259999998 podStartE2EDuration="6.61724532s" totalImagesPullingTime="4.650120094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:40:33.615826213 +0000 UTC m=+529.478763922" watchObservedRunningTime="2026-09-09 18:40:33.61724532 +0000 UTC m=+529.480183020"
Sep 09 18:40:35.130759 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.130725    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9xdcg"]
Sep 09 18:40:35.134064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.134040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.136631 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.136613    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 18:40:35.137504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.137482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 18:40:35.137603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.137490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l2gw4\""
Sep 09 18:40:35.145827 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.145801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9xdcg"]
Sep 09 18:40:35.313001 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.312956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmcq\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-kube-api-access-whmcq\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.313189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.313074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.413823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.413785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmcq\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-kube-api-access-whmcq\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.413982 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.413860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.428252 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.428220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.428377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.428293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmcq\" (UniqueName: \"kubernetes.io/projected/912acacb-92f0-4928-8a03-9427036a52d1-kube-api-access-whmcq\") pod \"cert-manager-webhook-6486ffd997-9xdcg\" (UID: \"912acacb-92f0-4928-8a03-9427036a52d1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.457136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.457112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:35.730474 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.730441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9xdcg"]
Sep 09 18:40:35.730890 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:35.730866    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod912acacb_92f0_4928_8a03_9427036a52d1.slice/crio-a96feb77d2c0b6f32bdbecca6b5503edb8d73a2deaf4fc43047e8439296f1a41 WatchSource:0}: Error finding container a96feb77d2c0b6f32bdbecca6b5503edb8d73a2deaf4fc43047e8439296f1a41: Status 404 returned error can't find the container with id a96feb77d2c0b6f32bdbecca6b5503edb8d73a2deaf4fc43047e8439296f1a41
Sep 09 18:40:35.731766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.731740    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"]
Sep 09 18:40:35.736325 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.736308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:35.738703 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.738678    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 18:40:35.738785 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.738740    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 18:40:35.738831 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.738787    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxf5l\""
Sep 09 18:40:35.749164 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.749142    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"]
Sep 09 18:40:35.916689 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.916650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tm27\" (UniqueName: \"kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:35.916689 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.916694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:35.916909 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:35.916770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.018291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.018199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tm27\" (UniqueName: \"kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.018291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.018243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.018527 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.018299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.018686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.018664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.018729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.018713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.027616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.027594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tm27\" (UniqueName: \"kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.045511 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.045483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:36.319139 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.319111    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"]
Sep 09 18:40:36.321355 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:36.321331    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acef57a_02d1_46b7_82fa_015f7dfd7c55.slice/crio-5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce WatchSource:0}: Error finding container 5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce: Status 404 returned error can't find the container with id 5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce
Sep 09 18:40:36.608644 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.608549    2561 generic.go:356] "Generic (PLEG): container finished" podID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerID="bbd0bba6dbd41273192c88a744bce68e70da4ac28c929c508a549f92f74297f7" exitCode=0
Sep 09 18:40:36.608836 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.608636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h" event={"ID":"1acef57a-02d1-46b7-82fa-015f7dfd7c55","Type":"ContainerDied","Data":"bbd0bba6dbd41273192c88a744bce68e70da4ac28c929c508a549f92f74297f7"}
Sep 09 18:40:36.608836 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.608687    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h" event={"ID":"1acef57a-02d1-46b7-82fa-015f7dfd7c55","Type":"ContainerStarted","Data":"5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce"}
Sep 09 18:40:36.610092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.610069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg" event={"ID":"912acacb-92f0-4928-8a03-9427036a52d1","Type":"ContainerStarted","Data":"a96feb77d2c0b6f32bdbecca6b5503edb8d73a2deaf4fc43047e8439296f1a41"}
Sep 09 18:40:36.794460 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.794420    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"]
Sep 09 18:40:36.797734 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.797706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:36.800292 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.800268    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wzf6l\""
Sep 09 18:40:36.807635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.807611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"]
Sep 09 18:40:36.925195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.925160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5jc\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-kube-api-access-lh5jc\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:36.925195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:36.925199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.026256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.026214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5jc\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-kube-api-access-lh5jc\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.026487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.026270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.035778 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.035745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5jc\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-kube-api-access-lh5jc\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.035924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.035864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ee60bba-d664-411a-9e26-7b2baa397f52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qjqj2\" (UID: \"3ee60bba-d664-411a-9e26-7b2baa397f52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.109018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.108978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"
Sep 09 18:40:37.387483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.387413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2"]
Sep 09 18:40:37.390546 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:37.390508    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ee60bba_d664_411a_9e26_7b2baa397f52.slice/crio-9e9a5bf580bdddb7e596e540e98f1ec887d1372d963c352fba1922c628c3b289 WatchSource:0}: Error finding container 9e9a5bf580bdddb7e596e540e98f1ec887d1372d963c352fba1922c628c3b289: Status 404 returned error can't find the container with id 9e9a5bf580bdddb7e596e540e98f1ec887d1372d963c352fba1922c628c3b289
Sep 09 18:40:37.618188 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:37.618119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2" event={"ID":"3ee60bba-d664-411a-9e26-7b2baa397f52","Type":"ContainerStarted","Data":"9e9a5bf580bdddb7e596e540e98f1ec887d1372d963c352fba1922c628c3b289"}
Sep 09 18:40:39.628590 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.628490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg" event={"ID":"912acacb-92f0-4928-8a03-9427036a52d1","Type":"ContainerStarted","Data":"cf5a6409c3638cb3cd2a73eac6c3dbad32083ba45cb1cb1995732ca7aa0f7408"}
Sep 09 18:40:39.629022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.628682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:39.630543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.630519    2561 generic.go:356] "Generic (PLEG): container finished" podID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerID="44bcf377566cacf7e8908ce35c40373f16beb684db378ff0acfd6b7593bab7e0" exitCode=0
Sep 09 18:40:39.630692 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.630591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h" event={"ID":"1acef57a-02d1-46b7-82fa-015f7dfd7c55","Type":"ContainerDied","Data":"44bcf377566cacf7e8908ce35c40373f16beb684db378ff0acfd6b7593bab7e0"}
Sep 09 18:40:39.632314 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.632291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2" event={"ID":"3ee60bba-d664-411a-9e26-7b2baa397f52","Type":"ContainerStarted","Data":"b45dfc3e7fe0e67e71326a869838c14e2686d5d5b301c5f64d590b43c06bdd38"}
Sep 09 18:40:39.663175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.663123    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg" podStartSLOduration=1.066325394 podStartE2EDuration="4.663107676s" totalImagesPullingTime="3.596782282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:40:39.661889927 +0000 UTC m=+535.524827625" watchObservedRunningTime="2026-09-09 18:40:39.663107676 +0000 UTC m=+535.526045373"
Sep 09 18:40:39.727329 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:39.727262    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qjqj2" podStartSLOduration=1.7268764559999998 podStartE2EDuration="3.727239819s" totalImagesPullingTime="2.000363363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:40:39.725731245 +0000 UTC m=+535.588668937" watchObservedRunningTime="2026-09-09 18:40:39.727239819 +0000 UTC m=+535.590177517"
Sep 09 18:40:40.638489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:40.638385    2561 generic.go:356] "Generic (PLEG): container finished" podID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerID="fc2cc1e300442f5fa956eb585ab0d5fe7273290570846897067c441ade3c4005" exitCode=0
Sep 09 18:40:40.638489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:40.638423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h" event={"ID":"1acef57a-02d1-46b7-82fa-015f7dfd7c55","Type":"ContainerDied","Data":"fc2cc1e300442f5fa956eb585ab0d5fe7273290570846897067c441ade3c4005"}
Sep 09 18:40:41.771384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.771359    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:41.967622 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.967533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tm27\" (UniqueName: \"kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27\") pod \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") "
Sep 09 18:40:41.967622 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.967608    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle\") pod \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") "
Sep 09 18:40:41.967804 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.967671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util\") pod \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\" (UID: \"1acef57a-02d1-46b7-82fa-015f7dfd7c55\") "
Sep 09 18:40:41.967992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.967967    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle" (OuterVolumeSpecName: "bundle") pod "1acef57a-02d1-46b7-82fa-015f7dfd7c55" (UID: "1acef57a-02d1-46b7-82fa-015f7dfd7c55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:41.969744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.969722    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27" (OuterVolumeSpecName: "kube-api-access-5tm27") pod "1acef57a-02d1-46b7-82fa-015f7dfd7c55" (UID: "1acef57a-02d1-46b7-82fa-015f7dfd7c55"). InnerVolumeSpecName "kube-api-access-5tm27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:40:41.999930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:41.999888    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util" (OuterVolumeSpecName: "util") pod "1acef57a-02d1-46b7-82fa-015f7dfd7c55" (UID: "1acef57a-02d1-46b7-82fa-015f7dfd7c55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:42.068216 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.068177    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tm27\" (UniqueName: \"kubernetes.io/projected/1acef57a-02d1-46b7-82fa-015f7dfd7c55-kube-api-access-5tm27\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:42.068216 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.068207    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:42.068216 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.068216    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1acef57a-02d1-46b7-82fa-015f7dfd7c55-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:42.649016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.648984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h" event={"ID":"1acef57a-02d1-46b7-82fa-015f7dfd7c55","Type":"ContainerDied","Data":"5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce"}
Sep 09 18:40:42.649016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.649003    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9nt9h"
Sep 09 18:40:42.649213 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:42.649030    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e83f3b1a9104e8a29e03828fe0141f587d19dea645a8a3cc8654c24be133cce"
Sep 09 18:40:45.035589 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035554    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ts2zh"]
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035866    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="pull"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035879    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="pull"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035887    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="extract"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035892    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="extract"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035901    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="util"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035907    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="util"
Sep 09 18:40:45.035999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.035980    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acef57a-02d1-46b7-82fa-015f7dfd7c55" containerName="extract"
Sep 09 18:40:45.038993 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.038975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.041041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.041018    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c4vlt\""
Sep 09 18:40:45.047818 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.047790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ts2zh"]
Sep 09 18:40:45.089733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.089694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92g5w\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-kube-api-access-92g5w\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.089901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.089781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-bound-sa-token\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.190932 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.190899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-bound-sa-token\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.191112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.190985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92g5w\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-kube-api-access-92g5w\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.198821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.198789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92g5w\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-kube-api-access-92g5w\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.198974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.198952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dac4fb64-ace5-4b88-80b9-e559aef433d0-bound-sa-token\") pod \"cert-manager-55b4d954d5-ts2zh\" (UID: \"dac4fb64-ace5-4b88-80b9-e559aef433d0\") " pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.348102 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.348000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ts2zh"
Sep 09 18:40:45.618416 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.618376    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ts2zh"]
Sep 09 18:40:45.620602 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:45.620575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac4fb64_ace5_4b88_80b9_e559aef433d0.slice/crio-a983e63ab11b09557d32c227f8e7c3c0356c3eba557521d5fca60f57dc56ca4d WatchSource:0}: Error finding container a983e63ab11b09557d32c227f8e7c3c0356c3eba557521d5fca60f57dc56ca4d: Status 404 returned error can't find the container with id a983e63ab11b09557d32c227f8e7c3c0356c3eba557521d5fca60f57dc56ca4d
Sep 09 18:40:45.641878 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.641849    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9xdcg"
Sep 09 18:40:45.663886 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:45.663853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ts2zh" event={"ID":"dac4fb64-ace5-4b88-80b9-e559aef433d0","Type":"ContainerStarted","Data":"a983e63ab11b09557d32c227f8e7c3c0356c3eba557521d5fca60f57dc56ca4d"}
Sep 09 18:40:46.670843 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:46.670795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ts2zh" event={"ID":"dac4fb64-ace5-4b88-80b9-e559aef433d0","Type":"ContainerStarted","Data":"50b252ae63565e0a4969c7f877dc478832e1c268fe023bd3e6720093bf5d22d0"}
Sep 09 18:40:46.687197 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:46.687151    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ts2zh" podStartSLOduration=1.68713595 podStartE2EDuration="1.68713595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:40:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:40:46.686512368 +0000 UTC m=+542.549450060" watchObservedRunningTime="2026-09-09 18:40:46.68713595 +0000 UTC m=+542.550073648"
Sep 09 18:40:52.730458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.730420    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"]
Sep 09 18:40:52.776626 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.776594    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"]
Sep 09 18:40:52.776791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.776696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.779640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.779611    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 18:40:52.779787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.779681    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxf5l\""
Sep 09 18:40:52.779787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.779777    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 18:40:52.848591 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.848559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.848771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.848597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plrs8\" (UniqueName: \"kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.848771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.848674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.949368 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.949333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.949547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.949382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.949547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.949425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plrs8\" (UniqueName: \"kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.949741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.949714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.949778 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.949748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:52.958707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:52.958684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plrs8\" (UniqueName: \"kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:53.086204 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:53.086121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:53.382041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:53.382013    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"]
Sep 09 18:40:53.384782 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:40:53.384756    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc07104c_3d4f_4e9b_92ce_4022c7aa5627.slice/crio-139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd WatchSource:0}: Error finding container 139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd: Status 404 returned error can't find the container with id 139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd
Sep 09 18:40:53.702366 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:53.702330    2561 generic.go:356] "Generic (PLEG): container finished" podID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerID="f048dcb93972432436f38dcc9cad096bc8cc6553fe627abd0c741b31422f8575" exitCode=0
Sep 09 18:40:53.702549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:53.702428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn" event={"ID":"fc07104c-3d4f-4e9b-92ce-4022c7aa5627","Type":"ContainerDied","Data":"f048dcb93972432436f38dcc9cad096bc8cc6553fe627abd0c741b31422f8575"}
Sep 09 18:40:53.702549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:53.702476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn" event={"ID":"fc07104c-3d4f-4e9b-92ce-4022c7aa5627","Type":"ContainerStarted","Data":"139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd"}
Sep 09 18:40:54.960556 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:40:54.960526    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc07104c_3d4f_4e9b_92ce_4022c7aa5627.slice/crio-conmon-ba8b8374fc12f2915be08c20b685535a0d372aa8a8307f5d2d32e77a2219d899.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 18:40:55.713121 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:55.713081    2561 generic.go:356] "Generic (PLEG): container finished" podID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerID="ba8b8374fc12f2915be08c20b685535a0d372aa8a8307f5d2d32e77a2219d899" exitCode=0
Sep 09 18:40:55.713282 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:55.713171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn" event={"ID":"fc07104c-3d4f-4e9b-92ce-4022c7aa5627","Type":"ContainerDied","Data":"ba8b8374fc12f2915be08c20b685535a0d372aa8a8307f5d2d32e77a2219d899"}
Sep 09 18:40:56.720159 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:56.720121    2561 generic.go:356] "Generic (PLEG): container finished" podID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerID="935e89e838a792778956d8288c1cf922be42c4d9457f05b73442a2a8481a3d26" exitCode=0
Sep 09 18:40:56.720587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:56.720216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn" event={"ID":"fc07104c-3d4f-4e9b-92ce-4022c7aa5627","Type":"ContainerDied","Data":"935e89e838a792778956d8288c1cf922be42c4d9457f05b73442a2a8481a3d26"}
Sep 09 18:40:57.845142 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.845119    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:57.893615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.893583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util\") pod \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") "
Sep 09 18:40:57.893615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.893618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plrs8\" (UniqueName: \"kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8\") pod \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") "
Sep 09 18:40:57.893821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.893678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle\") pod \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\" (UID: \"fc07104c-3d4f-4e9b-92ce-4022c7aa5627\") "
Sep 09 18:40:57.894443 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.894415    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle" (OuterVolumeSpecName: "bundle") pod "fc07104c-3d4f-4e9b-92ce-4022c7aa5627" (UID: "fc07104c-3d4f-4e9b-92ce-4022c7aa5627"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:57.895855 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.895826    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8" (OuterVolumeSpecName: "kube-api-access-plrs8") pod "fc07104c-3d4f-4e9b-92ce-4022c7aa5627" (UID: "fc07104c-3d4f-4e9b-92ce-4022c7aa5627"). InnerVolumeSpecName "kube-api-access-plrs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:40:57.899535 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.899513    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util" (OuterVolumeSpecName: "util") pod "fc07104c-3d4f-4e9b-92ce-4022c7aa5627" (UID: "fc07104c-3d4f-4e9b-92ce-4022c7aa5627"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:40:57.995110 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.995037    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:57.995110 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.995063    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:57.995110 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:57.995072    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plrs8\" (UniqueName: \"kubernetes.io/projected/fc07104c-3d4f-4e9b-92ce-4022c7aa5627-kube-api-access-plrs8\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:40:58.731637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:58.731602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn" event={"ID":"fc07104c-3d4f-4e9b-92ce-4022c7aa5627","Type":"ContainerDied","Data":"139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd"}
Sep 09 18:40:58.731637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:58.731633    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhktbn"
Sep 09 18:40:58.731830 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:40:58.731656    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="139d0218e61aa621898f4d051d4228a6a1ce21bcb646c62141205599d4fd96cd"
Sep 09 18:41:10.037912 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.037870    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"]
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038314    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="util"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038337    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="util"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038357    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="extract"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038366    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="extract"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038387    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="pull"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038415    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="pull"
Sep 09 18:41:10.038517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.038511    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc07104c-3d4f-4e9b-92ce-4022c7aa5627" containerName="extract"
Sep 09 18:41:10.041729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.041707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.044583 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.044555    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 18:41:10.044716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.044698    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 18:41:10.045335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.045317    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxf5l\""
Sep 09 18:41:10.058495 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.058471    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"]
Sep 09 18:41:10.096282 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.096248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.096485 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.096311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.096485 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.096331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frt8s\" (UniqueName: \"kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.197227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.197189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.197227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.197229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frt8s\" (UniqueName: \"kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.197471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.197335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.197665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.197649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.197701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.197656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.215757 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.215732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frt8s\" (UniqueName: \"kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.256508 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.256469    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"]
Sep 09 18:41:10.259878 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.259860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.263077 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.263051    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jqmk5\""
Sep 09 18:41:10.263616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.263592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 18:41:10.263729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.263640    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 18:41:10.263729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.263648    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 18:41:10.265152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.265137    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 18:41:10.313696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.313597    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"]
Sep 09 18:41:10.351601 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.351569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:10.398492 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.398458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-tmp\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.398669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.398498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.398669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.398589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-manifests\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.398669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.398634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.398669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.398656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wkq\" (UniqueName: \"kubernetes.io/projected/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-kube-api-access-l9wkq\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.499551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.499510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-tmp\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.499551 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.499554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.499762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.499595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-manifests\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.499762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.499614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.499762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.499641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wkq\" (UniqueName: \"kubernetes.io/projected/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-kube-api-access-l9wkq\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.500071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.500027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-manifests\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.501852 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.501824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-tmp\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.502089 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.502069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.502157 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.502108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.514930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.514903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wkq\" (UniqueName: \"kubernetes.io/projected/ca2d216d-6a4a-4b31-937f-dcd3b137c55e-kube-api-access-l9wkq\") pod \"opendatahub-operator-controller-manager-5f66f47469-qxf22\" (UID: \"ca2d216d-6a4a-4b31-937f-dcd3b137c55e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.571130 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.571034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:10.673202 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.673173    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"]
Sep 09 18:41:10.790094 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.790063    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c0eec-8f99-4840-820c-a07787b2d076" containerID="afc2bd3eb0f61c627856941b5708834f2a280a7fb93551ddc5b03fa0640559aa" exitCode=0
Sep 09 18:41:10.790242 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.790128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7" event={"ID":"478c0eec-8f99-4840-820c-a07787b2d076","Type":"ContainerDied","Data":"afc2bd3eb0f61c627856941b5708834f2a280a7fb93551ddc5b03fa0640559aa"}
Sep 09 18:41:10.790242 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.790164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7" event={"ID":"478c0eec-8f99-4840-820c-a07787b2d076","Type":"ContainerStarted","Data":"f9633eb7fc46670078f76c534dea43e79b239912717875a70e7119e76ad5d71a"}
Sep 09 18:41:10.880688 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:10.880587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"]
Sep 09 18:41:10.883070 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:41:10.883041    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2d216d_6a4a_4b31_937f_dcd3b137c55e.slice/crio-4747392d2a591f09e32cc1dd47d2a8a12bb809fe9ec1b3930ad7db26638c7bc8 WatchSource:0}: Error finding container 4747392d2a591f09e32cc1dd47d2a8a12bb809fe9ec1b3930ad7db26638c7bc8: Status 404 returned error can't find the container with id 4747392d2a591f09e32cc1dd47d2a8a12bb809fe9ec1b3930ad7db26638c7bc8
Sep 09 18:41:11.797195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:11.797164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22" event={"ID":"ca2d216d-6a4a-4b31-937f-dcd3b137c55e","Type":"ContainerStarted","Data":"4747392d2a591f09e32cc1dd47d2a8a12bb809fe9ec1b3930ad7db26638c7bc8"}
Sep 09 18:41:11.799022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:11.798995    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c0eec-8f99-4840-820c-a07787b2d076" containerID="109de042c568a3100bc7343b2aa8539c9f3725038573b600697a1b180d10204a" exitCode=0
Sep 09 18:41:11.799147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:11.799041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7" event={"ID":"478c0eec-8f99-4840-820c-a07787b2d076","Type":"ContainerDied","Data":"109de042c568a3100bc7343b2aa8539c9f3725038573b600697a1b180d10204a"}
Sep 09 18:41:12.808361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:12.808328    2561 generic.go:356] "Generic (PLEG): container finished" podID="478c0eec-8f99-4840-820c-a07787b2d076" containerID="fb9e6c0ea420a7edcd7f2112bdf49782f175bc9f18df5bee8b5084bf89e3193a" exitCode=0
Sep 09 18:41:12.808828 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:12.808365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7" event={"ID":"478c0eec-8f99-4840-820c-a07787b2d076","Type":"ContainerDied","Data":"fb9e6c0ea420a7edcd7f2112bdf49782f175bc9f18df5bee8b5084bf89e3193a"}
Sep 09 18:41:14.207919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.207893    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:14.334814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.334778    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util\") pod \"478c0eec-8f99-4840-820c-a07787b2d076\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") "
Sep 09 18:41:14.334814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.334817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frt8s\" (UniqueName: \"kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s\") pod \"478c0eec-8f99-4840-820c-a07787b2d076\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") "
Sep 09 18:41:14.334972 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.334877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle\") pod \"478c0eec-8f99-4840-820c-a07787b2d076\" (UID: \"478c0eec-8f99-4840-820c-a07787b2d076\") "
Sep 09 18:41:14.335576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.335553    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle" (OuterVolumeSpecName: "bundle") pod "478c0eec-8f99-4840-820c-a07787b2d076" (UID: "478c0eec-8f99-4840-820c-a07787b2d076"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:41:14.336975 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.336952    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s" (OuterVolumeSpecName: "kube-api-access-frt8s") pod "478c0eec-8f99-4840-820c-a07787b2d076" (UID: "478c0eec-8f99-4840-820c-a07787b2d076"). InnerVolumeSpecName "kube-api-access-frt8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:41:14.339529 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.339499    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util" (OuterVolumeSpecName: "util") pod "478c0eec-8f99-4840-820c-a07787b2d076" (UID: "478c0eec-8f99-4840-820c-a07787b2d076"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:41:14.435765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.435723    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:41:14.435765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.435753    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478c0eec-8f99-4840-820c-a07787b2d076-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:41:14.435765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.435762    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frt8s\" (UniqueName: \"kubernetes.io/projected/478c0eec-8f99-4840-820c-a07787b2d076-kube-api-access-frt8s\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:41:14.822943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.822893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22" event={"ID":"ca2d216d-6a4a-4b31-937f-dcd3b137c55e","Type":"ContainerStarted","Data":"e77b4095e8f6756aab86449eab16282f8f2545f3f37f5b2326b40f0314545c73"}
Sep 09 18:41:14.824813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.824779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7" event={"ID":"478c0eec-8f99-4840-820c-a07787b2d076","Type":"ContainerDied","Data":"f9633eb7fc46670078f76c534dea43e79b239912717875a70e7119e76ad5d71a"}
Sep 09 18:41:14.824813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.824796    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0pnqv7"
Sep 09 18:41:14.824968 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:14.824821    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9633eb7fc46670078f76c534dea43e79b239912717875a70e7119e76ad5d71a"
Sep 09 18:41:15.833560 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:15.833526    2561 generic.go:356] "Generic (PLEG): container finished" podID="ca2d216d-6a4a-4b31-937f-dcd3b137c55e" containerID="e77b4095e8f6756aab86449eab16282f8f2545f3f37f5b2326b40f0314545c73" exitCode=0
Sep 09 18:41:15.833947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:15.833612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22" event={"ID":"ca2d216d-6a4a-4b31-937f-dcd3b137c55e","Type":"ContainerDied","Data":"e77b4095e8f6756aab86449eab16282f8f2545f3f37f5b2326b40f0314545c73"}
Sep 09 18:41:16.840664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:16.840624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22" event={"ID":"ca2d216d-6a4a-4b31-937f-dcd3b137c55e","Type":"ContainerStarted","Data":"a108ed19e92a4da24d29c7aa8b7c6842d8d4081d10abd8c63407218d7e6db633"}
Sep 09 18:41:16.841046 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:16.840751    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:16.888962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:16.888908    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22" podStartSLOduration=2.12940414 podStartE2EDuration="6.888890197s" totalImagesPullingTime="3.732601557s" totalInitContainerRuntime="1.0268845s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:41:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:41:16.887701609 +0000 UTC m=+572.750639309" watchObservedRunningTime="2026-09-09 18:41:16.888890197 +0000 UTC m=+572.751827894"
Sep 09 18:41:27.848062 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:27.848026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f66f47469-qxf22"
Sep 09 18:41:34.246272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246235    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c6fc8bc6-xn79t"]
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246559    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="util"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246571    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="util"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246584    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="pull"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246591    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="pull"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246597    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="extract"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246603    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="extract"
Sep 09 18:41:34.246695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.246671    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="478c0eec-8f99-4840-820c-a07787b2d076" containerName="extract"
Sep 09 18:41:34.258957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.258930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.290675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.290645    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c6fc8bc6-xn79t"]
Sep 09 18:41:34.399230 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399230 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkjx\" (UniqueName: \"kubernetes.io/projected/33f5ff80-812d-4ed9-8db9-e5e1921fe206-kube-api-access-7qkjx\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-trusted-ca-bundle\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-oauth-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-oauth-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-service-ca\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.399510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.399498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.500999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.500891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkjx\" (UniqueName: \"kubernetes.io/projected/33f5ff80-812d-4ed9-8db9-e5e1921fe206-kube-api-access-7qkjx\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.500999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.500940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-trusted-ca-bundle\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.500999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.500974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-oauth-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.501312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.501005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-oauth-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.501312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.501057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-service-ca\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.501312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.501082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.501312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.501149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.501857 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.501827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-oauth-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.502040 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.502004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-trusted-ca-bundle\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.502214 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.502188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-service-ca\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.502380 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.502192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.504835 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.504797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-oauth-config\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.510740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.510717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33f5ff80-812d-4ed9-8db9-e5e1921fe206-console-serving-cert\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.542794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.542762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkjx\" (UniqueName: \"kubernetes.io/projected/33f5ff80-812d-4ed9-8db9-e5e1921fe206-kube-api-access-7qkjx\") pod \"console-56c6fc8bc6-xn79t\" (UID: \"33f5ff80-812d-4ed9-8db9-e5e1921fe206\") " pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.568607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.568580    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:34.871234 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.871209    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c6fc8bc6-xn79t"]
Sep 09 18:41:34.873689 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:41:34.873665    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f5ff80_812d_4ed9_8db9_e5e1921fe206.slice/crio-1c12c9f0d46c6155c15312731e8346b5f8456d738242e89954841c01ed830e3f WatchSource:0}: Error finding container 1c12c9f0d46c6155c15312731e8346b5f8456d738242e89954841c01ed830e3f: Status 404 returned error can't find the container with id 1c12c9f0d46c6155c15312731e8346b5f8456d738242e89954841c01ed830e3f
Sep 09 18:41:34.926581 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:34.926546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c6fc8bc6-xn79t" event={"ID":"33f5ff80-812d-4ed9-8db9-e5e1921fe206","Type":"ContainerStarted","Data":"1c12c9f0d46c6155c15312731e8346b5f8456d738242e89954841c01ed830e3f"}
Sep 09 18:41:35.937938 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:35.937899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c6fc8bc6-xn79t" event={"ID":"33f5ff80-812d-4ed9-8db9-e5e1921fe206","Type":"ContainerStarted","Data":"45a00d57cf3fc150b73004eab39713b1072744a799ca8e21a3c6f0791eb4104d"}
Sep 09 18:41:35.985796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:35.985740    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c6fc8bc6-xn79t" podStartSLOduration=1.985717006 podStartE2EDuration="1.985717006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:41:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:41:35.982601542 +0000 UTC m=+591.845539259" watchObservedRunningTime="2026-09-09 18:41:35.985717006 +0000 UTC m=+591.848654703"
Sep 09 18:41:38.047147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.047110    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"]
Sep 09 18:41:38.050523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.050505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.055612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.055588    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 18:41:38.056505 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.056481    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 18:41:38.056863 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.056843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r8d4c\""
Sep 09 18:41:38.057361 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.057338    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 18:41:38.057483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.057437    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 18:41:38.057923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.057908    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 18:41:38.066373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.066344    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"]
Sep 09 18:41:38.233740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.233701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.233740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.233751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-metrics-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.234005 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.233836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfkxt\" (UniqueName: \"kubernetes.io/projected/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-kube-api-access-zfkxt\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.234005 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.233939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-manager-config\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.334543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.334456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfkxt\" (UniqueName: \"kubernetes.io/projected/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-kube-api-access-zfkxt\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.334543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.334543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-manager-config\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.334766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.334579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.334766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.334596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-metrics-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.335251 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.335228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-manager-config\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.336978 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.336959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.337059 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.337042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-metrics-cert\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.348464 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.348436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfkxt\" (UniqueName: \"kubernetes.io/projected/8e0a2f63-a86b-4860-ad7e-f6f1ee2da823-kube-api-access-zfkxt\") pod \"lws-controller-manager-96799d79b-frdn7\" (UID: \"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823\") " pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.361432 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.361406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:38.651923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.651890    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"]
Sep 09 18:41:38.654239 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:41:38.654210    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0a2f63_a86b_4860_ad7e_f6f1ee2da823.slice/crio-f40dd20c85f08124521f2d2f93896e34c6ca7e21b3b3951138bce75501588b07 WatchSource:0}: Error finding container f40dd20c85f08124521f2d2f93896e34c6ca7e21b3b3951138bce75501588b07: Status 404 returned error can't find the container with id f40dd20c85f08124521f2d2f93896e34c6ca7e21b3b3951138bce75501588b07
Sep 09 18:41:38.952983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:38.952904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7" event={"ID":"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823","Type":"ContainerStarted","Data":"f40dd20c85f08124521f2d2f93896e34c6ca7e21b3b3951138bce75501588b07"}
Sep 09 18:41:42.238193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.238162    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"]
Sep 09 18:41:42.242040 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.242016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.255692 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.255672    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 18:41:42.255930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.255915    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-smgvk\""
Sep 09 18:41:42.309630 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.309590    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"]
Sep 09 18:41:42.369362 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q97gj\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-kube-api-access-q97gj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.369834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.369668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.470716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.470687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q97gj\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-kube-api-access-q97gj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.470793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.470726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.470793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.470770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.470951 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.470928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471057 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.470974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471057 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471057 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471584 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471689 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471853 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.471962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.471941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.473299 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.473279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.473459 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.473441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.505146 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.505083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.506688 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.506667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q97gj\" (UniqueName: \"kubernetes.io/projected/6f86deb5-0b9a-442b-a6ee-33a56b02008c-kube-api-access-q97gj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9\" (UID: \"6f86deb5-0b9a-442b-a6ee-33a56b02008c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.554581 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.554555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:42.974857 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.974819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7" event={"ID":"8e0a2f63-a86b-4860-ad7e-f6f1ee2da823","Type":"ContainerStarted","Data":"77361fd3ef417499adcef5af3b3440f7ba078f6f42f10703324b7ff3facd269b"}
Sep 09 18:41:42.975063 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:42.974881    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:41:43.020960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:43.020932    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"]
Sep 09 18:41:43.022637 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:41:43.022608    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f86deb5_0b9a_442b_a6ee_33a56b02008c.slice/crio-884d9f19e078313b9c1920991162d20ef6c66fcb6a961104efb9b0d30b44c975 WatchSource:0}: Error finding container 884d9f19e078313b9c1920991162d20ef6c66fcb6a961104efb9b0d30b44c975: Status 404 returned error can't find the container with id 884d9f19e078313b9c1920991162d20ef6c66fcb6a961104efb9b0d30b44c975
Sep 09 18:41:43.074606 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:43.074554    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7" podStartSLOduration=1.274947768 podStartE2EDuration="5.074537117s" totalImagesPullingTime="3.799589349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:41:43.074422436 +0000 UTC m=+598.937360144" watchObservedRunningTime="2026-09-09 18:41:43.074537117 +0000 UTC m=+598.937474815"
Sep 09 18:41:43.980239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:43.980201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9" event={"ID":"6f86deb5-0b9a-442b-a6ee-33a56b02008c","Type":"ContainerStarted","Data":"884d9f19e078313b9c1920991162d20ef6c66fcb6a961104efb9b0d30b44c975"}
Sep 09 18:41:44.217424 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.215731    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rklcm"]
Sep 09 18:41:44.220019 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.219991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.224504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.224476    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 18:41:44.238014 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.237944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rklcm"]
Sep 09 18:41:44.388410 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.388359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jf8g\" (UniqueName: \"kubernetes.io/projected/18ad24ff-42f4-43fd-b655-ea605601dbad-kube-api-access-8jf8g\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.388597 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.388471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.489534 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.489450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jf8g\" (UniqueName: \"kubernetes.io/projected/18ad24ff-42f4-43fd-b655-ea605601dbad-kube-api-access-8jf8g\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.489534 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.489505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.492410 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.492373    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 18:41:44.500560 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:41:44.500535    2561 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 09 18:41:44.500776 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:41:44.500604    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs podName:18ad24ff-42f4-43fd-b655-ea605601dbad nodeName:}" failed. No retries permitted until 2026-09-09 18:41:45.000584385 +0000 UTC m=+600.863522081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs") pod "model-serving-api-54d89bd5fc-rklcm" (UID: "18ad24ff-42f4-43fd-b655-ea605601dbad") : secret "model-serving-api-tls" not found
Sep 09 18:41:44.501149 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.501123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jf8g\" (UniqueName: \"kubernetes.io/projected/18ad24ff-42f4-43fd-b655-ea605601dbad-kube-api-access-8jf8g\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:44.556520 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.556486    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:41:44.556678 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.556586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:41:44.568849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.568815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:44.569291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.569259    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:44.575459 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.575432    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:44.992291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:44.992186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c6fc8bc6-xn79t"
Sep 09 18:41:45.081635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:45.081601    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:41:45.096017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:45.095981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:45.099017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:45.098993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18ad24ff-42f4-43fd-b655-ea605601dbad-tls-certs\") pod \"model-serving-api-54d89bd5fc-rklcm\" (UID: \"18ad24ff-42f4-43fd-b655-ea605601dbad\") " pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:45.135363 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:45.135324    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:46.105818 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:46.105782    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:41:46.106120 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:46.105858    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:41:46.106120 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:46.105888    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:41:46.308793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:46.308765    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rklcm"]
Sep 09 18:41:46.310323 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:41:46.310290    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ad24ff_42f4_43fd_b655_ea605601dbad.slice/crio-75351c97d5f509fbee07c83d06bfe4da69dd77855a943b12b61c396a91aced7e WatchSource:0}: Error finding container 75351c97d5f509fbee07c83d06bfe4da69dd77855a943b12b61c396a91aced7e: Status 404 returned error can't find the container with id 75351c97d5f509fbee07c83d06bfe4da69dd77855a943b12b61c396a91aced7e
Sep 09 18:41:47.000163 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:47.000121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9" event={"ID":"6f86deb5-0b9a-442b-a6ee-33a56b02008c","Type":"ContainerStarted","Data":"9a98dc250e87ddbaa2357e1b3a50001a7d88688197f05082a170567bd72fd968"}
Sep 09 18:41:47.001450 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:47.001422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm" event={"ID":"18ad24ff-42f4-43fd-b655-ea605601dbad","Type":"ContainerStarted","Data":"75351c97d5f509fbee07c83d06bfe4da69dd77855a943b12b61c396a91aced7e"}
Sep 09 18:41:47.042422 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:47.042365    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9" podStartSLOduration=1.962328368 podStartE2EDuration="5.042349284s" totalImagesPullingTime="3.080020916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:41:47.039326446 +0000 UTC m=+602.902264156" watchObservedRunningTime="2026-09-09 18:41:47.042349284 +0000 UTC m=+602.905286979"
Sep 09 18:41:47.554694 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:47.554657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:47.559749 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:47.559722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:48.007471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:48.007434    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:48.008539 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:48.008515    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9"
Sep 09 18:41:50.018816 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:50.018708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm" event={"ID":"18ad24ff-42f4-43fd-b655-ea605601dbad","Type":"ContainerStarted","Data":"ce40b7e7e0170fa509c481253ea569f4b05647be81d46208499cfd3f91436af6"}
Sep 09 18:41:50.019233 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:50.018978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:41:50.059387 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:50.059338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm" podStartSLOduration=2.676965796 podStartE2EDuration="6.059322101s" totalImagesPullingTime="3.382356305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:41:50.056373227 +0000 UTC m=+605.919310950" watchObservedRunningTime="2026-09-09 18:41:50.059322101 +0000 UTC m=+605.922259820"
Sep 09 18:41:53.982714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:41:53.982678    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-96799d79b-frdn7"
Sep 09 18:42:01.028191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:01.028159    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rklcm"
Sep 09 18:42:10.104316 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.104229    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df99bfd75-6djts" podUID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" containerName="console" containerID="cri-o://58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b" gracePeriod=15
Sep 09 18:42:10.353388 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.353363    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:42:10.428585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428543    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428590    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428627    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmbpt\" (UniqueName: \"kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428686    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.428803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428744    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle\") pod \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\" (UID: \"fb51b701-ffca-42c2-aa60-c3a35d5b9b50\") "
Sep 09 18:42:10.429064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.428953    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config" (OuterVolumeSpecName: "console-config") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:42:10.429187 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.429157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:42:10.429294 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.429183    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:42:10.429342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.429283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:42:10.430900 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.430877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt" (OuterVolumeSpecName: "kube-api-access-kmbpt") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "kube-api-access-kmbpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:42:10.431211 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.431187    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:42:10.431290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.431268    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb51b701-ffca-42c2-aa60-c3a35d5b9b50" (UID: "fb51b701-ffca-42c2-aa60-c3a35d5b9b50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:42:10.529825 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529792    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-trusted-ca-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.529825 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529819    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.529825 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529828    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.530048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529837    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-console-oauth-config\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.530048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529846    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-oauth-serving-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.530048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529854    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmbpt\" (UniqueName: \"kubernetes.io/projected/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-kube-api-access-kmbpt\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:10.530048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:10.529862    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb51b701-ffca-42c2-aa60-c3a35d5b9b50-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:11.121655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.121616    2561 generic.go:356] "Generic (PLEG): container finished" podID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" containerID="58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b" exitCode=0
Sep 09 18:42:11.122066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.121680    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df99bfd75-6djts"
Sep 09 18:42:11.122066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.121717    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df99bfd75-6djts" event={"ID":"fb51b701-ffca-42c2-aa60-c3a35d5b9b50","Type":"ContainerDied","Data":"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"}
Sep 09 18:42:11.122066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.121810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df99bfd75-6djts" event={"ID":"fb51b701-ffca-42c2-aa60-c3a35d5b9b50","Type":"ContainerDied","Data":"0dbe654dea5ad43459c83948ee59c66fc534a45ffb1759a197038424aa3837a1"}
Sep 09 18:42:11.122066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.121833    2561 scope.go:117] "RemoveContainer" containerID="58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"
Sep 09 18:42:11.130249 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.130229    2561 scope.go:117] "RemoveContainer" containerID="58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"
Sep 09 18:42:11.130564 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:42:11.130543    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b\": container with ID starting with 58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b not found: ID does not exist" containerID="58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"
Sep 09 18:42:11.130639 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.130573    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b"} err="failed to get container status \"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b\": rpc error: code = NotFound desc = could not find container \"58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b\": container with ID starting with 58998ef5d2df276f7f9da4888a0331a214be61062cba55298b04369a49ad192b not found: ID does not exist"
Sep 09 18:42:11.155058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.155032    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:42:11.171600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:11.171574    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df99bfd75-6djts"]
Sep 09 18:42:12.608486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:12.608451    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" path="/var/lib/kubelet/pods/fb51b701-ffca-42c2-aa60-c3a35d5b9b50/volumes"
Sep 09 18:42:52.595420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.595358    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"]
Sep 09 18:42:52.595874 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.595721    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" containerName="console"
Sep 09 18:42:52.595874 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.595733    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" containerName="console"
Sep 09 18:42:52.595874 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.595796    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb51b701-ffca-42c2-aa60-c3a35d5b9b50" containerName="console"
Sep 09 18:42:52.600197 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.600177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.603776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.603756    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 18:42:52.603902 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.603758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxf5l\""
Sep 09 18:42:52.604423 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.604406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 18:42:52.619119 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.619090    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"]
Sep 09 18:42:52.701815 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.701780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.701986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.701823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45sq2\" (UniqueName: \"kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.701986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.701880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.726071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.726032    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"]
Sep 09 18:42:52.729670 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.729648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.749066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.749040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"]
Sep 09 18:42:52.802884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.802845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.803054 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.802897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcf4\" (UniqueName: \"kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.803054 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.802947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.803054 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.803048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.803227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.803093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45sq2\" (UniqueName: \"kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.803227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.803134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.803337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.803229    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.803422 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.803355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.815516 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.815487    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45sq2\" (UniqueName: \"kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.887765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.887682    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"]
Sep 09 18:42:52.891403 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.891368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:52.903680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.903656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.903829 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.903698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcf4\" (UniqueName: \"kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.903829 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.903734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.904050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.904022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.904136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.904050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:52.907587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.907561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"]
Sep 09 18:42:52.910198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.910175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:52.941466 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:52.941428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcf4\" (UniqueName: \"kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:53.004167 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.004132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbzq\" (UniqueName: \"kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.004307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.004180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.004307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.004209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.039216 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.039181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:53.061441 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.060737    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"]
Sep 09 18:42:53.064723 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.064701    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.095168 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.094759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"]
Sep 09 18:42:53.104918 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.104896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbzq\" (UniqueName: \"kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.105018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.104943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.105018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.104987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.105423 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.105404    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.105498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.105436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.123296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.123273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbzq\" (UniqueName: \"kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.192476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.192453    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"]
Sep 09 18:42:53.194261 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:42:53.194236    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51abdd68_750b_4139_9922_2763a4282348.slice/crio-5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8 WatchSource:0}: Error finding container 5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8: Status 404 returned error can't find the container with id 5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8
Sep 09 18:42:53.200778 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.200759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:53.205945 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.205924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.206013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.205970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.206092 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.206069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrjj\" (UniqueName: \"kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.307371 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.307341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.307518 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.307384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.307586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.307545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrjj\" (UniqueName: \"kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.307707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.307691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.307750 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.307727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.318380 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.318357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrjj\" (UniqueName: \"kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.324018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.323916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"]
Sep 09 18:42:53.329366 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.329336    2561 generic.go:356] "Generic (PLEG): container finished" podID="51abdd68-750b-4139-9922-2763a4282348" containerID="b3735545570fe4e3c5180e0b9c0ea1b17b8589b5e8b9471b018ae2040698f96a" exitCode=0
Sep 09 18:42:53.329470 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.329425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj" event={"ID":"51abdd68-750b-4139-9922-2763a4282348","Type":"ContainerDied","Data":"b3735545570fe4e3c5180e0b9c0ea1b17b8589b5e8b9471b018ae2040698f96a"}
Sep 09 18:42:53.329540 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.329478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj" event={"ID":"51abdd68-750b-4139-9922-2763a4282348","Type":"ContainerStarted","Data":"5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8"}
Sep 09 18:42:53.349306 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:42:53.349275    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b5950a_ebc9_4444_b148_ec7800042985.slice/crio-7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1 WatchSource:0}: Error finding container 7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1: Status 404 returned error can't find the container with id 7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1
Sep 09 18:42:53.374479 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.374428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:53.491755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.491727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"]
Sep 09 18:42:53.515325 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:42:53.515292    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf133745f_f5a3_415f_a931_f8ef966f9929.slice/crio-884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d WatchSource:0}: Error finding container 884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d: Status 404 returned error can't find the container with id 884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d
Sep 09 18:42:53.662772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:53.662738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"]
Sep 09 18:42:53.684269 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:42:53.684238    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8266220f_c058_41d1_8730_a3ef3dd72e97.slice/crio-1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c WatchSource:0}: Error finding container 1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c: Status 404 returned error can't find the container with id 1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c
Sep 09 18:42:54.335762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.335732    2561 generic.go:356] "Generic (PLEG): container finished" podID="51abdd68-750b-4139-9922-2763a4282348" containerID="66d555c0c57a562f3342cedf42637b6e3d262a722a238e632784f50c261a91bc" exitCode=0
Sep 09 18:42:54.335903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.335786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj" event={"ID":"51abdd68-750b-4139-9922-2763a4282348","Type":"ContainerDied","Data":"66d555c0c57a562f3342cedf42637b6e3d262a722a238e632784f50c261a91bc"}
Sep 09 18:42:54.337484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.337462    2561 generic.go:356] "Generic (PLEG): container finished" podID="f133745f-f5a3-415f-a931-f8ef966f9929" containerID="2c6f8ee402f976300f6231bd654d3b93cdda2fa554e500ab0f47dd3710df492c" exitCode=0
Sep 09 18:42:54.337715 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.337550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn" event={"ID":"f133745f-f5a3-415f-a931-f8ef966f9929","Type":"ContainerDied","Data":"2c6f8ee402f976300f6231bd654d3b93cdda2fa554e500ab0f47dd3710df492c"}
Sep 09 18:42:54.337715 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.337599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn" event={"ID":"f133745f-f5a3-415f-a931-f8ef966f9929","Type":"ContainerStarted","Data":"884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d"}
Sep 09 18:42:54.339210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.339171    2561 generic.go:356] "Generic (PLEG): container finished" podID="71b5950a-ebc9-4444-b148-ec7800042985" containerID="bc5e6fad6a6a1e0d9f5496e09c81a78153f720928663a2de2280eac698db8ecc" exitCode=0
Sep 09 18:42:54.339304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.339253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42" event={"ID":"71b5950a-ebc9-4444-b148-ec7800042985","Type":"ContainerDied","Data":"bc5e6fad6a6a1e0d9f5496e09c81a78153f720928663a2de2280eac698db8ecc"}
Sep 09 18:42:54.339304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.339294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42" event={"ID":"71b5950a-ebc9-4444-b148-ec7800042985","Type":"ContainerStarted","Data":"7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1"}
Sep 09 18:42:54.341075 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.341053    2561 generic.go:356] "Generic (PLEG): container finished" podID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerID="6b887406c70f7d0b94ed78fbc59f8194de6b3a0ef470d348746ae3a42f46d8ca" exitCode=0
Sep 09 18:42:54.341149 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.341130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2" event={"ID":"8266220f-c058-41d1-8730-a3ef3dd72e97","Type":"ContainerDied","Data":"6b887406c70f7d0b94ed78fbc59f8194de6b3a0ef470d348746ae3a42f46d8ca"}
Sep 09 18:42:54.341205 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:54.341165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2" event={"ID":"8266220f-c058-41d1-8730-a3ef3dd72e97","Type":"ContainerStarted","Data":"1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c"}
Sep 09 18:42:55.351326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:55.351293    2561 generic.go:356] "Generic (PLEG): container finished" podID="51abdd68-750b-4139-9922-2763a4282348" containerID="b33c3effa3dc1ca232d35f61e1b86d3fbc208467e74584e6a1558d4dc9c4541f" exitCode=0
Sep 09 18:42:55.351742 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:55.351371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj" event={"ID":"51abdd68-750b-4139-9922-2763a4282348","Type":"ContainerDied","Data":"b33c3effa3dc1ca232d35f61e1b86d3fbc208467e74584e6a1558d4dc9c4541f"}
Sep 09 18:42:56.358073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.358036    2561 generic.go:356] "Generic (PLEG): container finished" podID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerID="2ab28e611aaf26a1e8c85c334a4f86784614a35ab7b130ea89c798eae29a8195" exitCode=0
Sep 09 18:42:56.358522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.358119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2" event={"ID":"8266220f-c058-41d1-8730-a3ef3dd72e97","Type":"ContainerDied","Data":"2ab28e611aaf26a1e8c85c334a4f86784614a35ab7b130ea89c798eae29a8195"}
Sep 09 18:42:56.360321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.360300    2561 generic.go:356] "Generic (PLEG): container finished" podID="f133745f-f5a3-415f-a931-f8ef966f9929" containerID="17ebeb7b968efce39b2ced7c15950d31cdc614a95f9970e6d6d470d2f6b05434" exitCode=0
Sep 09 18:42:56.360411 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.360375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn" event={"ID":"f133745f-f5a3-415f-a931-f8ef966f9929","Type":"ContainerDied","Data":"17ebeb7b968efce39b2ced7c15950d31cdc614a95f9970e6d6d470d2f6b05434"}
Sep 09 18:42:56.362306 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.362283    2561 generic.go:356] "Generic (PLEG): container finished" podID="71b5950a-ebc9-4444-b148-ec7800042985" containerID="51ee994a83c681c30231ad519d30ba1d9d5b295dd8642c4a147e52d3ecb7380e" exitCode=0
Sep 09 18:42:56.362413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.362331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42" event={"ID":"71b5950a-ebc9-4444-b148-ec7800042985","Type":"ContainerDied","Data":"51ee994a83c681c30231ad519d30ba1d9d5b295dd8642c4a147e52d3ecb7380e"}
Sep 09 18:42:56.516335 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.516301    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:56.640610 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.640579    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45sq2\" (UniqueName: \"kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2\") pod \"51abdd68-750b-4139-9922-2763a4282348\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") "
Sep 09 18:42:56.640733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.640620    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle\") pod \"51abdd68-750b-4139-9922-2763a4282348\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") "
Sep 09 18:42:56.640733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.640645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util\") pod \"51abdd68-750b-4139-9922-2763a4282348\" (UID: \"51abdd68-750b-4139-9922-2763a4282348\") "
Sep 09 18:42:56.641143 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.641107    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle" (OuterVolumeSpecName: "bundle") pod "51abdd68-750b-4139-9922-2763a4282348" (UID: "51abdd68-750b-4139-9922-2763a4282348"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:56.642724 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.642700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2" (OuterVolumeSpecName: "kube-api-access-45sq2") pod "51abdd68-750b-4139-9922-2763a4282348" (UID: "51abdd68-750b-4139-9922-2763a4282348"). InnerVolumeSpecName "kube-api-access-45sq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:42:56.646074 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.646050    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util" (OuterVolumeSpecName: "util") pod "51abdd68-750b-4139-9922-2763a4282348" (UID: "51abdd68-750b-4139-9922-2763a4282348"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:56.741772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.741739    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45sq2\" (UniqueName: \"kubernetes.io/projected/51abdd68-750b-4139-9922-2763a4282348-kube-api-access-45sq2\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:56.741772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.741771    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:56.741971 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:56.741784    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51abdd68-750b-4139-9922-2763a4282348-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:57.369592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.369561    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj"
Sep 09 18:42:57.370025 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.369563    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cht4tj" event={"ID":"51abdd68-750b-4139-9922-2763a4282348","Type":"ContainerDied","Data":"5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8"}
Sep 09 18:42:57.370025 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.369681    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ea2c7fc9aabfcb4d9e9ce3546cf2edffb2d5300d6a58b56d6992075f4b8e2f8"
Sep 09 18:42:57.371750 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.371722    2561 generic.go:356] "Generic (PLEG): container finished" podID="f133745f-f5a3-415f-a931-f8ef966f9929" containerID="1bcca7967d01bb8f1ed1d313eb6a6034579130543605fba0349db7784c03e2b9" exitCode=0
Sep 09 18:42:57.371885 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.371800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn" event={"ID":"f133745f-f5a3-415f-a931-f8ef966f9929","Type":"ContainerDied","Data":"1bcca7967d01bb8f1ed1d313eb6a6034579130543605fba0349db7784c03e2b9"}
Sep 09 18:42:57.374047 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.374022    2561 generic.go:356] "Generic (PLEG): container finished" podID="71b5950a-ebc9-4444-b148-ec7800042985" containerID="627cf13c29ea044acf47161472c200251960046fddeea6a36f858b00d9a9a8d5" exitCode=0
Sep 09 18:42:57.374166 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.374108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42" event={"ID":"71b5950a-ebc9-4444-b148-ec7800042985","Type":"ContainerDied","Data":"627cf13c29ea044acf47161472c200251960046fddeea6a36f858b00d9a9a8d5"}
Sep 09 18:42:57.376136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.376113    2561 generic.go:356] "Generic (PLEG): container finished" podID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerID="8fa3c95ba85b688fb92fb853b55f9a7b200fbc470f98b972c4e4af9268212977" exitCode=0
Sep 09 18:42:57.376261 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:57.376239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2" event={"ID":"8266220f-c058-41d1-8730-a3ef3dd72e97","Type":"ContainerDied","Data":"8fa3c95ba85b688fb92fb853b55f9a7b200fbc470f98b972c4e4af9268212977"}
Sep 09 18:42:58.518961 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.518936    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:58.561632 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.561610    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:58.565078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.565057    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:58.656621 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656595    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle\") pod \"71b5950a-ebc9-4444-b148-ec7800042985\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") "
Sep 09 18:42:58.656788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656632    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util\") pod \"f133745f-f5a3-415f-a931-f8ef966f9929\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") "
Sep 09 18:42:58.656788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656659    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle\") pod \"f133745f-f5a3-415f-a931-f8ef966f9929\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") "
Sep 09 18:42:58.656788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656722    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfrjj\" (UniqueName: \"kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj\") pod \"8266220f-c058-41d1-8730-a3ef3dd72e97\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") "
Sep 09 18:42:58.656788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util\") pod \"8266220f-c058-41d1-8730-a3ef3dd72e97\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") "
Sep 09 18:42:58.656788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle\") pod \"8266220f-c058-41d1-8730-a3ef3dd72e97\" (UID: \"8266220f-c058-41d1-8730-a3ef3dd72e97\") "
Sep 09 18:42:58.657083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkcf4\" (UniqueName: \"kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4\") pod \"71b5950a-ebc9-4444-b148-ec7800042985\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") "
Sep 09 18:42:58.657083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656853    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjbzq\" (UniqueName: \"kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq\") pod \"f133745f-f5a3-415f-a931-f8ef966f9929\" (UID: \"f133745f-f5a3-415f-a931-f8ef966f9929\") "
Sep 09 18:42:58.657083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.656884    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util\") pod \"71b5950a-ebc9-4444-b148-ec7800042985\" (UID: \"71b5950a-ebc9-4444-b148-ec7800042985\") "
Sep 09 18:42:58.657262 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.657238    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle" (OuterVolumeSpecName: "bundle") pod "71b5950a-ebc9-4444-b148-ec7800042985" (UID: "71b5950a-ebc9-4444-b148-ec7800042985"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.657614 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.657583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle" (OuterVolumeSpecName: "bundle") pod "f133745f-f5a3-415f-a931-f8ef966f9929" (UID: "f133745f-f5a3-415f-a931-f8ef966f9929"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.657770 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.657744    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle" (OuterVolumeSpecName: "bundle") pod "8266220f-c058-41d1-8730-a3ef3dd72e97" (UID: "8266220f-c058-41d1-8730-a3ef3dd72e97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.659021 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.658998    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj" (OuterVolumeSpecName: "kube-api-access-gfrjj") pod "8266220f-c058-41d1-8730-a3ef3dd72e97" (UID: "8266220f-c058-41d1-8730-a3ef3dd72e97"). InnerVolumeSpecName "kube-api-access-gfrjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:42:58.659292 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.659264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq" (OuterVolumeSpecName: "kube-api-access-bjbzq") pod "f133745f-f5a3-415f-a931-f8ef966f9929" (UID: "f133745f-f5a3-415f-a931-f8ef966f9929"). InnerVolumeSpecName "kube-api-access-bjbzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:42:58.659500 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.659453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4" (OuterVolumeSpecName: "kube-api-access-mkcf4") pod "71b5950a-ebc9-4444-b148-ec7800042985" (UID: "71b5950a-ebc9-4444-b148-ec7800042985"). InnerVolumeSpecName "kube-api-access-mkcf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:42:58.665276 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.664342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util" (OuterVolumeSpecName: "util") pod "8266220f-c058-41d1-8730-a3ef3dd72e97" (UID: "8266220f-c058-41d1-8730-a3ef3dd72e97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.757648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757609    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfrjj\" (UniqueName: \"kubernetes.io/projected/8266220f-c058-41d1-8730-a3ef3dd72e97-kube-api-access-gfrjj\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757643    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757655    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8266220f-c058-41d1-8730-a3ef3dd72e97-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757667    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkcf4\" (UniqueName: \"kubernetes.io/projected/71b5950a-ebc9-4444-b148-ec7800042985-kube-api-access-mkcf4\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757681    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjbzq\" (UniqueName: \"kubernetes.io/projected/f133745f-f5a3-415f-a931-f8ef966f9929-kube-api-access-bjbzq\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757692    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.757897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.757708    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-bundle\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.809558 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.809516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util" (OuterVolumeSpecName: "util") pod "71b5950a-ebc9-4444-b148-ec7800042985" (UID: "71b5950a-ebc9-4444-b148-ec7800042985"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.812616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.812590    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util" (OuterVolumeSpecName: "util") pod "f133745f-f5a3-415f-a931-f8ef966f9929" (UID: "f133745f-f5a3-415f-a931-f8ef966f9929"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:42:58.858408 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.858371    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71b5950a-ebc9-4444-b148-ec7800042985-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:58.858534 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:58.858418    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f133745f-f5a3-415f-a931-f8ef966f9929-util\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:42:59.387261 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.387215    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn" event={"ID":"f133745f-f5a3-415f-a931-f8ef966f9929","Type":"ContainerDied","Data":"884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d"}
Sep 09 18:42:59.387478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.387239    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67f2mn"
Sep 09 18:42:59.387478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.387307    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="884edee5049e282a56680e5f088daac9802381f9174652bce870070c93ec510d"
Sep 09 18:42:59.389097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.389068    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42"
Sep 09 18:42:59.389097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.389089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v2j42" event={"ID":"71b5950a-ebc9-4444-b148-ec7800042985","Type":"ContainerDied","Data":"7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1"}
Sep 09 18:42:59.389263 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.389129    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e8199fe3a7cff6a61d237d66765132cfcf4f9e75712030cb70d51713a1936a1"
Sep 09 18:42:59.391047 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.391026    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2"
Sep 09 18:42:59.391145 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.391052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ammnt2" event={"ID":"8266220f-c058-41d1-8730-a3ef3dd72e97","Type":"ContainerDied","Data":"1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c"}
Sep 09 18:42:59.391145 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:42:59.391087    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a83215c359cf8526895215445ef7e0e1bb9581f0a8adb536662dd1e9e3c0b2c"
Sep 09 18:43:07.825788 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.825744    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"]
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826131    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="extract"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826144    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="extract"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826155    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="util"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826160    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="util"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826171    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="pull"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826176    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="pull"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826184    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="extract"
Sep 09 18:43:07.826182 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826189    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826201    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826206    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826213    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826218    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826224    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826228    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826233    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826238    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826245    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826250    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826257    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826262    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="pull"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826269    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826273    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="util"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826279    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826284    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826336    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8266220f-c058-41d1-8730-a3ef3dd72e97" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826343    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b5950a-ebc9-4444-b148-ec7800042985" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826349    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f133745f-f5a3-415f-a931-f8ef966f9929" containerName="extract"
Sep 09 18:43:07.826481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.826355    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="51abdd68-750b-4139-9922-2763a4282348" containerName="extract"
Sep 09 18:43:07.831438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.831417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:07.833908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.833876    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 18:43:07.834227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.834211    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-c2wm6\""
Sep 09 18:43:07.834478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.834461    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 18:43:07.868003 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.867970    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"]
Sep 09 18:43:07.940687 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.940633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:07.940889 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:07.940708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx58j\" (UniqueName: \"kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.042051 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.042011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx58j\" (UniqueName: \"kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.042232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.042117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.042544 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.042522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.063035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.063008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx58j\" (UniqueName: \"kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.141839 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.141804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:08.435313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:08.435234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"]
Sep 09 18:43:08.449085 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:43:08.449059    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb63e4cb_5620_4ebe_9ba6_4cb6fc0b9e56.slice/crio-c2f5d00f591d1467dd8efa09f81841a2ed9b0eeef5d752356ef09ff47e90ce0d WatchSource:0}: Error finding container c2f5d00f591d1467dd8efa09f81841a2ed9b0eeef5d752356ef09ff47e90ce0d: Status 404 returned error can't find the container with id c2f5d00f591d1467dd8efa09f81841a2ed9b0eeef5d752356ef09ff47e90ce0d
Sep 09 18:43:09.443973 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:09.443939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb" event={"ID":"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56","Type":"ContainerStarted","Data":"c2f5d00f591d1467dd8efa09f81841a2ed9b0eeef5d752356ef09ff47e90ce0d"}
Sep 09 18:43:12.984800 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:12.984722    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"]
Sep 09 18:43:12.988296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:12.988279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:12.992612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:12.992588    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 18:43:12.992856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:12.992838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8sdsx\""
Sep 09 18:43:13.005279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.005253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"]
Sep 09 18:43:13.091281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.091247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bht4s\" (UniqueName: \"kubernetes.io/projected/bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba-kube-api-access-bht4s\") pod \"dns-operator-controller-manager-7b84cd7c9c-sj85v\" (UID: \"bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:13.192302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.192259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bht4s\" (UniqueName: \"kubernetes.io/projected/bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba-kube-api-access-bht4s\") pod \"dns-operator-controller-manager-7b84cd7c9c-sj85v\" (UID: \"bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:13.225782 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.225752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bht4s\" (UniqueName: \"kubernetes.io/projected/bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba-kube-api-access-bht4s\") pod \"dns-operator-controller-manager-7b84cd7c9c-sj85v\" (UID: \"bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:13.298796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.298711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:13.475463 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.475425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb" event={"ID":"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56","Type":"ContainerStarted","Data":"12000f7fc8b050f212987ca09db600b6445e7e1c49d354844a795304f3ae6019"}
Sep 09 18:43:13.475635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.475567    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:13.536683 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.536633    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb" podStartSLOduration=2.3071797800000002 podStartE2EDuration="6.536617269s" totalImagesPullingTime="4.229437489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:43:13.534943222 +0000 UTC m=+689.397880944" watchObservedRunningTime="2026-09-09 18:43:13.536617269 +0000 UTC m=+689.399554967"
Sep 09 18:43:13.630181 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:13.630153    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"]
Sep 09 18:43:13.632372 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:43:13.632342    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd7eb8c_83c6_4ba4_aef1_19bceaf209ba.slice/crio-d2ff88cb174f625042fd36e80cc32e8f9d9f8695f2d7d6e722da31aea6cbcbae WatchSource:0}: Error finding container d2ff88cb174f625042fd36e80cc32e8f9d9f8695f2d7d6e722da31aea6cbcbae: Status 404 returned error can't find the container with id d2ff88cb174f625042fd36e80cc32e8f9d9f8695f2d7d6e722da31aea6cbcbae
Sep 09 18:43:14.483062 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:14.483020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v" event={"ID":"bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba","Type":"ContainerStarted","Data":"d2ff88cb174f625042fd36e80cc32e8f9d9f8695f2d7d6e722da31aea6cbcbae"}
Sep 09 18:43:16.172283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.172245    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"]
Sep 09 18:43:16.175847 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.175829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.179822 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.179800    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j45lb\""
Sep 09 18:43:16.179959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.179800    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 09 18:43:16.179959 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.179823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 09 18:43:16.216928 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.216899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4s4v\" (UniqueName: \"kubernetes.io/projected/e9daecef-1b3d-45f1-bfed-d4f958f20223-kube-api-access-v4s4v\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.217086 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.216943    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.217086 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.216972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9daecef-1b3d-45f1-bfed-d4f958f20223-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.220619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.220593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"]
Sep 09 18:43:16.317733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.317688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4s4v\" (UniqueName: \"kubernetes.io/projected/e9daecef-1b3d-45f1-bfed-d4f958f20223-kube-api-access-v4s4v\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.317930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.317756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.317930 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:16.317862    2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 09 18:43:16.317930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.317883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9daecef-1b3d-45f1-bfed-d4f958f20223-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.317930 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:16.317930    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert podName:e9daecef-1b3d-45f1-bfed-d4f958f20223 nodeName:}" failed. No retries permitted until 2026-09-09 18:43:16.81791011 +0000 UTC m=+692.680847800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-sbh92" (UID: "e9daecef-1b3d-45f1-bfed-d4f958f20223") : secret "plugin-serving-cert" not found
Sep 09 18:43:16.318533 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.318514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9daecef-1b3d-45f1-bfed-d4f958f20223-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.349333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.349298    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4s4v\" (UniqueName: \"kubernetes.io/projected/e9daecef-1b3d-45f1-bfed-d4f958f20223-kube-api-access-v4s4v\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.496068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.495981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v" event={"ID":"bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba","Type":"ContainerStarted","Data":"d3e128ddacfaa78d60a9fa5e625d8d54efcbdf7a0897b93a2b4c40310a5699c1"}
Sep 09 18:43:16.496238 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.496119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:16.534796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.534739    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v" podStartSLOduration=2.500180642 podStartE2EDuration="4.534722725s" totalImagesPullingTime="2.034542083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:43:16.534279013 +0000 UTC m=+692.397216738" watchObservedRunningTime="2026-09-09 18:43:16.534722725 +0000 UTC m=+692.397660421"
Sep 09 18:43:16.821001 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.820913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:16.823311 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:16.823285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9daecef-1b3d-45f1-bfed-d4f958f20223-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-sbh92\" (UID: \"e9daecef-1b3d-45f1-bfed-d4f958f20223\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:17.084861 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:17.084772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"
Sep 09 18:43:17.380254 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:17.380165    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92"]
Sep 09 18:43:17.383073 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:43:17.383045    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9daecef_1b3d_45f1_bfed_d4f958f20223.slice/crio-16b97ab92c9aff1db1dcf54f1bedf646848075d4282f4a69243a34641abf29f8 WatchSource:0}: Error finding container 16b97ab92c9aff1db1dcf54f1bedf646848075d4282f4a69243a34641abf29f8: Status 404 returned error can't find the container with id 16b97ab92c9aff1db1dcf54f1bedf646848075d4282f4a69243a34641abf29f8
Sep 09 18:43:17.502748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:17.502713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92" event={"ID":"e9daecef-1b3d-45f1-bfed-d4f958f20223","Type":"ContainerStarted","Data":"16b97ab92c9aff1db1dcf54f1bedf646848075d4282f4a69243a34641abf29f8"}
Sep 09 18:43:22.538570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:22.538525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92" event={"ID":"e9daecef-1b3d-45f1-bfed-d4f958f20223","Type":"ContainerStarted","Data":"b97af06fcf304d89d5cf6f7d73c104679a53655820d8f4f40e7e396db500a729"}
Sep 09 18:43:22.566069 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:22.566017    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-sbh92" podStartSLOduration=2.1418794979999998 podStartE2EDuration="6.56600156s" totalImagesPullingTime="4.424122062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:43:22.564081712 +0000 UTC m=+698.427019411" watchObservedRunningTime="2026-09-09 18:43:22.56600156 +0000 UTC m=+698.428939257"
Sep 09 18:43:24.486036 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:24.486002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.402531 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.402491    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"]
Sep 09 18:43:27.403000 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.402738    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" containerName="manager" containerID="cri-o://12000f7fc8b050f212987ca09db600b6445e7e1c49d354844a795304f3ae6019" gracePeriod=2
Sep 09 18:43:27.423019 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.422993    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"]
Sep 09 18:43:27.439380 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:27.439339    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\": pods \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.504792 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.504761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-sj85v"
Sep 09 18:43:27.566680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.566644    2561 generic.go:356] "Generic (PLEG): container finished" podID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" containerID="12000f7fc8b050f212987ca09db600b6445e7e1c49d354844a795304f3ae6019" exitCode=0
Sep 09 18:43:27.569883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.569857    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:27.570207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.570196    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" containerName="manager"
Sep 09 18:43:27.570261 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.570209    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" containerName="manager"
Sep 09 18:43:27.570295 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.570266    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" containerName="manager"
Sep 09 18:43:27.573328 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.573311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.595601 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:27.595562    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.598992 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:27.598964    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.618746 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.618719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.618887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.618780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682pw\" (UniqueName: \"kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.633705 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.633658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:27.671610 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.671582    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.702356 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:27.702321    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:27.719630 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.719601    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx58j\" (UniqueName: \"kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j\") pod \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") "
Sep 09 18:43:27.719752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.719699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume\") pod \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\" (UID: \"fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56\") "
Sep 09 18:43:27.719849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.719826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.719964 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.719872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682pw\" (UniqueName: \"kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.720241 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.720209    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" (UID: "fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:43:27.720332 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.720269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.722032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.722010    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j" (OuterVolumeSpecName: "kube-api-access-rx58j") pod "fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" (UID: "fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56"). InnerVolumeSpecName "kube-api-access-rx58j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:43:27.758578 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.758551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682pw\" (UniqueName: \"kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qclc8\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:27.820820 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.820786    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx58j\" (UniqueName: \"kubernetes.io/projected/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-kube-api-access-rx58j\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:43:27.820820 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.820815    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56-extensions-socket-volume\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:43:27.885358 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:27.885322    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:28.196029 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.195988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:28.198351 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:43:28.198321    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3603ab23_9fb3_45a7_be38_da077ea8b3b2.slice/crio-4f59c7d5a2379114f4bd205f665ea0e9119fca687f6563370cc1aa6ed3ca65f9 WatchSource:0}: Error finding container 4f59c7d5a2379114f4bd205f665ea0e9119fca687f6563370cc1aa6ed3ca65f9: Status 404 returned error can't find the container with id 4f59c7d5a2379114f4bd205f665ea0e9119fca687f6563370cc1aa6ed3ca65f9
Sep 09 18:43:28.574279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.574183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" event={"ID":"3603ab23-9fb3-45a7-be38-da077ea8b3b2","Type":"ContainerStarted","Data":"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"}
Sep 09 18:43:28.574279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.574235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" event={"ID":"3603ab23-9fb3-45a7-be38-da077ea8b3b2","Type":"ContainerStarted","Data":"4f59c7d5a2379114f4bd205f665ea0e9119fca687f6563370cc1aa6ed3ca65f9"}
Sep 09 18:43:28.574279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.574269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:28.575673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.575652    2561 scope.go:117] "RemoveContainer" containerID="12000f7fc8b050f212987ca09db600b6445e7e1c49d354844a795304f3ae6019"
Sep 09 18:43:28.575673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.575665    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:28.608969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.608943    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" path="/var/lib/kubelet/pods/fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56/volumes"
Sep 09 18:43:28.649442 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:28.649366    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" podStartSLOduration=1.6493512849999998 podStartE2EDuration="1.649351285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:43:28.647279576 +0000 UTC m=+704.510217275" watchObservedRunningTime="2026-09-09 18:43:28.649351285 +0000 UTC m=+704.512288982"
Sep 09 18:43:28.653453 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:28.653420    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9pdqb\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="fb63e4cb-5620-4ebe-9ba6-4cb6fc0b9e56" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9pdqb"
Sep 09 18:43:30.914407 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:30.914368    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 18:43:30.919075 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:30.919057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:30.940242 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:30.940213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 18:43:30.948232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:30.948205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvkq\" (UniqueName: \"kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:30.948373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:30.948240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.049766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.049724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvkq\" (UniqueName: \"kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.049766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.049769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.050125 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.050109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.064355 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.064320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvkq\" (UniqueName: \"kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq\") pod \"kuadrant-operator-controller-manager-5769f99d9f-x6pfx\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.229239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.229145    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.528281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.528254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 18:43:31.530706 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:43:31.530677    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3438ed1_e15e_493a_bc6c_bee4ead044c5.slice/crio-626c8fccb5cbc061c28126bffdf597bea7bb632a52118b7ad6cf4d7aadb5c76c WatchSource:0}: Error finding container 626c8fccb5cbc061c28126bffdf597bea7bb632a52118b7ad6cf4d7aadb5c76c: Status 404 returned error can't find the container with id 626c8fccb5cbc061c28126bffdf597bea7bb632a52118b7ad6cf4d7aadb5c76c
Sep 09 18:43:31.596277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.596244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" event={"ID":"b3438ed1-e15e-493a-bc6c-bee4ead044c5","Type":"ContainerStarted","Data":"626c8fccb5cbc061c28126bffdf597bea7bb632a52118b7ad6cf4d7aadb5c76c"}
Sep 09 18:43:31.596424 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.596302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:31.631702 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:31.631645    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" podStartSLOduration=1.631627939 podStartE2EDuration="1.631627939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:43:31.628744784 +0000 UTC m=+707.491682501" watchObservedRunningTime="2026-09-09 18:43:31.631627939 +0000 UTC m=+707.494565637"
Sep 09 18:43:32.608618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:32.608586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" event={"ID":"b3438ed1-e15e-493a-bc6c-bee4ead044c5","Type":"ContainerStarted","Data":"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"}
Sep 09 18:43:39.585552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:39.585472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:43.615553 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:43.615519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 18:43:43.737063 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:43.737026    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:43.737275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:43.737237    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" podUID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" containerName="manager" containerID="cri-o://cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2" gracePeriod=10
Sep 09 18:43:43.981036 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:43.981008    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:44.065979 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.065945    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume\") pod \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") "
Sep 09 18:43:44.065979 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.065979    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-682pw\" (UniqueName: \"kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw\") pod \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\" (UID: \"3603ab23-9fb3-45a7-be38-da077ea8b3b2\") "
Sep 09 18:43:44.066347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.066323    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3603ab23-9fb3-45a7-be38-da077ea8b3b2" (UID: "3603ab23-9fb3-45a7-be38-da077ea8b3b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:43:44.068101 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.068071    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw" (OuterVolumeSpecName: "kube-api-access-682pw") pod "3603ab23-9fb3-45a7-be38-da077ea8b3b2" (UID: "3603ab23-9fb3-45a7-be38-da077ea8b3b2"). InnerVolumeSpecName "kube-api-access-682pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:43:44.166522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.166489    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3603ab23-9fb3-45a7-be38-da077ea8b3b2-extensions-socket-volume\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:43:44.166522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.166512    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-682pw\" (UniqueName: \"kubernetes.io/projected/3603ab23-9fb3-45a7-be38-da077ea8b3b2-kube-api-access-682pw\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:43:44.674628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.674594    2561 generic.go:356] "Generic (PLEG): container finished" podID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" containerID="cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2" exitCode=0
Sep 09 18:43:44.675028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.674636    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"
Sep 09 18:43:44.675028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.674668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" event={"ID":"3603ab23-9fb3-45a7-be38-da077ea8b3b2","Type":"ContainerDied","Data":"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"}
Sep 09 18:43:44.675028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.674719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8" event={"ID":"3603ab23-9fb3-45a7-be38-da077ea8b3b2","Type":"ContainerDied","Data":"4f59c7d5a2379114f4bd205f665ea0e9119fca687f6563370cc1aa6ed3ca65f9"}
Sep 09 18:43:44.675028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.674742    2561 scope.go:117] "RemoveContainer" containerID="cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"
Sep 09 18:43:44.683184 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.683165    2561 scope.go:117] "RemoveContainer" containerID="cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"
Sep 09 18:43:44.683482 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:43:44.683461    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2\": container with ID starting with cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2 not found: ID does not exist" containerID="cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"
Sep 09 18:43:44.683562 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.683490    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2"} err="failed to get container status \"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2\": rpc error: code = NotFound desc = could not find container \"cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2\": container with ID starting with cfe3e5a8d06da05b28f86550ca149afd55c1d3e96e58c292fe00257d36a1bda2 not found: ID does not exist"
Sep 09 18:43:44.711002 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.710970    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:44.719290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:44.719262    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qclc8"]
Sep 09 18:43:46.608562 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:43:46.608527    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" path="/var/lib/kubelet/pods/3603ab23-9fb3-45a7-be38-da077ea8b3b2/volumes"
Sep 09 18:44:00.461549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.461501    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"]
Sep 09 18:44:00.461958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.461941    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" containerName="manager"
Sep 09 18:44:00.461958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.461959    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" containerName="manager"
Sep 09 18:44:00.462066 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.462054    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3603ab23-9fb3-45a7-be38-da077ea8b3b2" containerName="manager"
Sep 09 18:44:00.484096 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.484068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.485200 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.485172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"]
Sep 09 18:44:00.486851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.486826    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dtrtv\""
Sep 09 18:44:00.615555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615724 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61be4672-4f0f-44ef-999b-6464adca0f00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615724 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615724 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615724 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615871 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x59nv\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-kube-api-access-x59nv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615871 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61be4672-4f0f-44ef-999b-6464adca0f00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615871 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.615871 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.615847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717349 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717349 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61be4672-4f0f-44ef-999b-6464adca0f00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x59nv\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-kube-api-access-x59nv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61be4672-4f0f-44ef-999b-6464adca0f00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.717801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.718006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.718006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.717962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.718192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.718172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.718251 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.718215    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61be4672-4f0f-44ef-999b-6464adca0f00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.719909 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.719887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61be4672-4f0f-44ef-999b-6464adca0f00-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.720152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.720134    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61be4672-4f0f-44ef-999b-6464adca0f00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.728386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.728360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x59nv\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-kube-api-access-x59nv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.728577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.728559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61be4672-4f0f-44ef-999b-6464adca0f00-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-985bs\" (UID: \"61be4672-4f0f-44ef-999b-6464adca0f00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:00.795531 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:00.795504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:01.080313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.080287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"]
Sep 09 18:44:01.082242 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:44:01.082211    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61be4672_4f0f_44ef_999b_6464adca0f00.slice/crio-826d2be9ae72911d848bc0bc7de61cc36132c11e88a675d7e6bb4661ad7b044b WatchSource:0}: Error finding container 826d2be9ae72911d848bc0bc7de61cc36132c11e88a675d7e6bb4661ad7b044b: Status 404 returned error can't find the container with id 826d2be9ae72911d848bc0bc7de61cc36132c11e88a675d7e6bb4661ad7b044b
Sep 09 18:44:01.084240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.084211    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:44:01.084337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.084275    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:44:01.084337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.084306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:44:01.771478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.771441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" event={"ID":"61be4672-4f0f-44ef-999b-6464adca0f00","Type":"ContainerStarted","Data":"39b1fb4d58c21092a3e9c4049cc1992610982e0b3f303f56fe66e2aea2c3f50b"}
Sep 09 18:44:01.771946 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.771504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" event={"ID":"61be4672-4f0f-44ef-999b-6464adca0f00","Type":"ContainerStarted","Data":"826d2be9ae72911d848bc0bc7de61cc36132c11e88a675d7e6bb4661ad7b044b"}
Sep 09 18:44:01.795984 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.795951    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:01.800591 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:01.800544    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podStartSLOduration=1.800526729 podStartE2EDuration="1.800526729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:44:01.797689782 +0000 UTC m=+737.660627530" watchObservedRunningTime="2026-09-09 18:44:01.800526729 +0000 UTC m=+737.663464427"
Sep 09 18:44:02.801247 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:02.801214    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:03.753174 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.753129    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:44:03.758476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.758446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.763333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.763311    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 18:44:03.783003 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.782975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:03.783560 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.783539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:44:03.784068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.784039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:44:03.846171 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.846138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/986d7b0a-ef58-4a78-bb8e-fd18db49332c-config-file\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.846580 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.846219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqf8s\" (UniqueName: \"kubernetes.io/projected/986d7b0a-ef58-4a78-bb8e-fd18db49332c-kube-api-access-mqf8s\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.895671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.895635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:44:03.947662 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.947630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/986d7b0a-ef58-4a78-bb8e-fd18db49332c-config-file\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.947837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.947689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqf8s\" (UniqueName: \"kubernetes.io/projected/986d7b0a-ef58-4a78-bb8e-fd18db49332c-kube-api-access-mqf8s\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.948292 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.948266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/986d7b0a-ef58-4a78-bb8e-fd18db49332c-config-file\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:03.959012 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:03.958987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqf8s\" (UniqueName: \"kubernetes.io/projected/986d7b0a-ef58-4a78-bb8e-fd18db49332c-kube-api-access-mqf8s\") pod \"limitador-limitador-84994f7ffc-qqwkc\" (UID: \"986d7b0a-ef58-4a78-bb8e-fd18db49332c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:04.069336 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:04.069243    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:04.366101 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:04.366074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:44:04.367848 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:44:04.367823    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986d7b0a_ef58_4a78_bb8e_fd18db49332c.slice/crio-0cd7e692ad181ac65c2d1e8452643259105ff0c550216023a7a2f245d50378fc WatchSource:0}: Error finding container 0cd7e692ad181ac65c2d1e8452643259105ff0c550216023a7a2f245d50378fc: Status 404 returned error can't find the container with id 0cd7e692ad181ac65c2d1e8452643259105ff0c550216023a7a2f245d50378fc
Sep 09 18:44:04.790120 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:04.790083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc" event={"ID":"986d7b0a-ef58-4a78-bb8e-fd18db49332c","Type":"ContainerStarted","Data":"0cd7e692ad181ac65c2d1e8452643259105ff0c550216023a7a2f245d50378fc"}
Sep 09 18:44:06.803640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:06.803597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc" event={"ID":"986d7b0a-ef58-4a78-bb8e-fd18db49332c","Type":"ContainerStarted","Data":"39599eb34b858fce5e5f1be382ea7f69307a2306c6a1798fd0c55c21e429e4e2"}
Sep 09 18:44:06.804080 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:06.803745    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:44:06.831824 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:06.831773    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc" podStartSLOduration=2.304927746 podStartE2EDuration="3.831756385s" totalImagesPullingTime="1.526828639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:44:06.830913077 +0000 UTC m=+742.693850767" watchObservedRunningTime="2026-09-09 18:44:06.831756385 +0000 UTC m=+742.694694083"
Sep 09 18:44:17.809587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:44:17.809555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"
Sep 09 18:45:17.818298 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:17.818211    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:45:27.242493 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.242457    2561 generic.go:356] "Generic (PLEG): container finished" podID="61be4672-4f0f-44ef-999b-6464adca0f00" containerID="39b1fb4d58c21092a3e9c4049cc1992610982e0b3f303f56fe66e2aea2c3f50b" exitCode=0
Sep 09 18:45:27.243017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.242521    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" event={"ID":"61be4672-4f0f-44ef-999b-6464adca0f00","Type":"ContainerDied","Data":"39b1fb4d58c21092a3e9c4049cc1992610982e0b3f303f56fe66e2aea2c3f50b"}
Sep 09 18:45:27.243017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.243008    2561 scope.go:117] "RemoveContainer" containerID="39b1fb4d58c21092a3e9c4049cc1992610982e0b3f303f56fe66e2aea2c3f50b"
Sep 09 18:45:27.244062 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.244032    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:45:27.244168 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.244117    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:45:27.244233 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:27.244166    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:45:28.255052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:28.254081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" event={"ID":"61be4672-4f0f-44ef-999b-6464adca0f00","Type":"ContainerStarted","Data":"157e0f81907480216be358d690cdfba64d04a7916f95b7406a277d1a2380ccd0"}
Sep 09 18:45:28.796278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:28.796252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:45:28.796550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:28.796527    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-985bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 18:45:28.796608 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:28.796578    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podUID="61be4672-4f0f-44ef-999b-6464adca0f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 18:45:29.796735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:29.796695    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-985bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 18:45:29.797144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:29.796765    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podUID="61be4672-4f0f-44ef-999b-6464adca0f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 18:45:30.796751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:30.796716    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-985bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 18:45:30.797222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:30.796782    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podUID="61be4672-4f0f-44ef-999b-6464adca0f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 18:45:31.796824 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:31.796791    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-985bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 18:45:31.797234 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:31.796845    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podUID="61be4672-4f0f-44ef-999b-6464adca0f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 18:45:32.796044 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:32.796004    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-985bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 09 18:45:32.796247 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:32.796073    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs" podUID="61be4672-4f0f-44ef-999b-6464adca0f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 09 18:45:33.505404 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:33.505362    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:45:33.783977 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:33.783871    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:45:33.846138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:33.846108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:45:34.290821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:34.290794    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-985bs"
Sep 09 18:45:38.323320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:38.323286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:45:49.596422 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:49.596370    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:45:53.745056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.745021    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"]
Sep 09 18:45:53.748712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.748693    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.750927 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.750908    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 18:45:53.751883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.751865    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 09 18:45:53.752208 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.752188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 18:45:53.752257 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.752197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9cfsg\""
Sep 09 18:45:53.757251 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.757225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"]
Sep 09 18:45:53.926998 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.926960    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.927212 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.927043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.927212 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.927105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b275997-1668-40fc-b90e-f03b1595aafd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.927212 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.927144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.927354 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.927217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:53.927354 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:53.927252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwvs\" (UniqueName: \"kubernetes.io/projected/5b275997-1668-40fc-b90e-f03b1595aafd-kube-api-access-zfwvs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.027884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.027884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwvs\" (UniqueName: \"kubernetes.io/projected/5b275997-1668-40fc-b90e-f03b1595aafd-kube-api-access-zfwvs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.027884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028107 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028107 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b275997-1668-40fc-b90e-f03b1595aafd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028107 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.027948    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028288 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.028263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028340 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.028310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.028340 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.028328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.030235 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.030211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b275997-1668-40fc-b90e-f03b1595aafd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.030489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.030473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b275997-1668-40fc-b90e-f03b1595aafd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.037031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.037007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwvs\" (UniqueName: \"kubernetes.io/projected/5b275997-1668-40fc-b90e-f03b1595aafd-kube-api-access-zfwvs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkr5t\" (UID: \"5b275997-1668-40fc-b90e-f03b1595aafd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.059615 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.059591    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:45:54.359575 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.359492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"]
Sep 09 18:45:54.364251 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:45:54.364223    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b275997_1668_40fc_b90e_f03b1595aafd.slice/crio-b96e9a9d0118a58cda4db3d4ec58bd1dc4c10570d7b3753ec324fdb239619bce WatchSource:0}: Error finding container b96e9a9d0118a58cda4db3d4ec58bd1dc4c10570d7b3753ec324fdb239619bce: Status 404 returned error can't find the container with id b96e9a9d0118a58cda4db3d4ec58bd1dc4c10570d7b3753ec324fdb239619bce
Sep 09 18:45:54.365572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.365541    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 18:45:54.402026 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:54.401993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t" event={"ID":"5b275997-1668-40fc-b90e-f03b1595aafd","Type":"ContainerStarted","Data":"b96e9a9d0118a58cda4db3d4ec58bd1dc4c10570d7b3753ec324fdb239619bce"}
Sep 09 18:45:55.103135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:55.103099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:45:56.414986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:56.414948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t" event={"ID":"5b275997-1668-40fc-b90e-f03b1595aafd","Type":"ContainerStarted","Data":"59050227ffe14af89eaa4eb1c1a6d5de4d3f65d0897cde5815fe8efb6d428010"}
Sep 09 18:45:56.438263 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:45:56.438208    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t" podStartSLOduration=2.441193086 podStartE2EDuration="3.438191308s" totalImagesPullingTime="996.998222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:45:56.436166642 +0000 UTC m=+852.299104353" watchObservedRunningTime="2026-09-09 18:45:56.438191308 +0000 UTC m=+852.301129006"
Sep 09 18:46:04.060860 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:04.060816    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:46:04.061262 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:04.060896    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:46:04.073190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:04.073162    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:46:04.471439 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:04.471413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkr5t"
Sep 09 18:46:23.305436 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:23.305401    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:46:39.305465 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:39.305374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:46:44.595713 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:44.595686    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:46:44.598982 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:44.598959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:46:51.100554 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:46:51.100512    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:48:09.608787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.608704    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:48:09.612637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.612611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.614968 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.614939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-90f815-openshift-default-dockercfg-6qhm4\""
Sep 09 18:48:09.627575 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.627547    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:48:09.793009 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.792961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793180 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793180 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793180 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m8m6\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.793476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.793358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m8m6\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.894672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895051 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895051 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895051 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.894958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.895160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.895177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.895436 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.895388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.897122 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.897101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.897265 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.897247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.903668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.903636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m8m6\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.903979 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.903962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token\") pod \"e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") " pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:09.922991 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:09.922963    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:10.204526 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:10.204499    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:48:10.206722 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:10.206693    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295615c0_4e5b_4f36_890e_c4ca4b6cb645.slice/crio-8607622705c7c279f52ab0ef2f77ae6ebe2ba0782030067db8bacfb8bdc73e91 WatchSource:0}: Error finding container 8607622705c7c279f52ab0ef2f77ae6ebe2ba0782030067db8bacfb8bdc73e91: Status 404 returned error can't find the container with id 8607622705c7c279f52ab0ef2f77ae6ebe2ba0782030067db8bacfb8bdc73e91
Sep 09 18:48:10.208979 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:10.208939    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:10.209055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:10.209031    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:10.209093 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:10.209076    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:11.152621 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.152585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerStarted","Data":"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"}
Sep 09 18:48:11.153025 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.152668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerStarted","Data":"8607622705c7c279f52ab0ef2f77ae6ebe2ba0782030067db8bacfb8bdc73e91"}
Sep 09 18:48:11.178034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.177980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podStartSLOduration=2.177963855 podStartE2EDuration="2.177963855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:11.175775763 +0000 UTC m=+987.038713479" watchObservedRunningTime="2026-09-09 18:48:11.177963855 +0000 UTC m=+987.040901553"
Sep 09 18:48:11.413454 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.413357    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7771-8e3d0d"]
Sep 09 18:48:11.416936 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.416920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:11.419185 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.419163    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s9dww\""
Sep 09 18:48:11.423640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.423617    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7771-8e3d0d"]
Sep 09 18:48:11.508471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.508433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97jvq\" (UniqueName: \"kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq\") pod \"test-curl-7771-8e3d0d\" (UID: \"f3ba912b-4e72-41c1-a42d-c77563d4a0d1\") " pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:11.609532 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.609498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97jvq\" (UniqueName: \"kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq\") pod \"test-curl-7771-8e3d0d\" (UID: \"f3ba912b-4e72-41c1-a42d-c77563d4a0d1\") " pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:11.618577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.618543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97jvq\" (UniqueName: \"kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq\") pod \"test-curl-7771-8e3d0d\" (UID: \"f3ba912b-4e72-41c1-a42d-c77563d4a0d1\") " pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:11.728169 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.728081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:11.924048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.924016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:11.928908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:11.928879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:12.007281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:12.007254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7771-8e3d0d"]
Sep 09 18:48:12.007889 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:12.007861    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3ba912b_4e72_41c1_a42d_c77563d4a0d1.slice/crio-c18fd28e6ab1165b0ee917a84ff0f17f27e9dae7c72c2de893cf1424a8290285 WatchSource:0}: Error finding container c18fd28e6ab1165b0ee917a84ff0f17f27e9dae7c72c2de893cf1424a8290285: Status 404 returned error can't find the container with id c18fd28e6ab1165b0ee917a84ff0f17f27e9dae7c72c2de893cf1424a8290285
Sep 09 18:48:12.159333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:12.159299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7771-8e3d0d" event={"ID":"f3ba912b-4e72-41c1-a42d-c77563d4a0d1","Type":"ContainerStarted","Data":"c18fd28e6ab1165b0ee917a84ff0f17f27e9dae7c72c2de893cf1424a8290285"}
Sep 09 18:48:12.159915 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:12.159602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:12.160656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:12.160630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:13.001018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:13.000978    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:48:17.697887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.697854    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:48:17.703142 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.703111    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.706328 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.706301    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d0c2fa5c-openshift-default-dockercfg-xhcvv\""
Sep 09 18:48:17.720063 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.720039    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:48:17.770627 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.770799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.770799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.770799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.770799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.770799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.771023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.771023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.771023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.770942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvx7\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872005 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.871949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvx7\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872218 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872218 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872218 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872218 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.872868 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.872800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.873034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.873014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.874567 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.874546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.874704 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.874687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.880217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.880191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:17.880734 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:17.880711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvx7\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7\") pod \"e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") " pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:18.015223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:18.015137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:18.293242 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:18.293213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:48:18.294360 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:18.294333    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd939f02f_27d9_49c9_ae8a_93ba2f76beb4.slice/crio-004aaef22e06d7de3a3539b299abb67272b820c9c5bb52be3f689ca497c36e54 WatchSource:0}: Error finding container 004aaef22e06d7de3a3539b299abb67272b820c9c5bb52be3f689ca497c36e54: Status 404 returned error can't find the container with id 004aaef22e06d7de3a3539b299abb67272b820c9c5bb52be3f689ca497c36e54
Sep 09 18:48:18.296659 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:18.296626    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:18.296733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:18.296695    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:18.296733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:18.296722    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:19.202978 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:19.202933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerStarted","Data":"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"}
Sep 09 18:48:19.203455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:19.203005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerStarted","Data":"004aaef22e06d7de3a3539b299abb67272b820c9c5bb52be3f689ca497c36e54"}
Sep 09 18:48:19.243499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:19.243444    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podStartSLOduration=2.243427704 podStartE2EDuration="2.243427704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:19.241159131 +0000 UTC m=+995.104096849" watchObservedRunningTime="2026-09-09 18:48:19.243427704 +0000 UTC m=+995.106365402"
Sep 09 18:48:20.015776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:20.015733    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:20.020752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:20.020721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:20.208932 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:20.208897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:20.209878 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:20.209853    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:26.266603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:26.266565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7771-8e3d0d" event={"ID":"f3ba912b-4e72-41c1-a42d-c77563d4a0d1","Type":"ContainerStarted","Data":"c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1"}
Sep 09 18:48:26.281884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:26.281830    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7771-8e3d0d" podStartSLOduration=1.797061352 podStartE2EDuration="15.281812907s" totalImagesPullingTime="13.484751555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:26.279241644 +0000 UTC m=+1002.142179342" watchObservedRunningTime="2026-09-09 18:48:26.281812907 +0000 UTC m=+1002.144750605"
Sep 09 18:48:26.901552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:26.901511    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7771-8e3d0d"]
Sep 09 18:48:26.908967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:26.908933    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7771-8e3d0d"]
Sep 09 18:48:27.034476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.034440    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7771-289376"]
Sep 09 18:48:27.035070 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.035048    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" containerName="test-curl-7771-8e3d0d"
Sep 09 18:48:27.035145 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.035073    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" containerName="test-curl-7771-8e3d0d"
Sep 09 18:48:27.035209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.035195    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" containerName="test-curl-7771-8e3d0d"
Sep 09 18:48:27.038958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.038931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:27.041275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.041245    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7771-289376"]
Sep 09 18:48:27.186421 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.186291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkrfp\" (UniqueName: \"kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp\") pod \"test-curl-7771-289376\" (UID: \"0a5c9767-1b36-4199-85bd-d80bee15ea98\") " pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:27.272503 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:27.272472    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7771-8e3d0d" container="test-curl-7771-8e3d0d"
Sep 09 18:48:27.287495 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.287463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkrfp\" (UniqueName: \"kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp\") pod \"test-curl-7771-289376\" (UID: \"0a5c9767-1b36-4199-85bd-d80bee15ea98\") " pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:27.295554 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.295517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkrfp\" (UniqueName: \"kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp\") pod \"test-curl-7771-289376\" (UID: \"0a5c9767-1b36-4199-85bd-d80bee15ea98\") " pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:27.354460 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.354417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:27.602842 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.602754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:48:27.626883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:27.626857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7771-289376"]
Sep 09 18:48:27.628328 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:27.628304    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a5c9767_1b36_4199_85bd_d80bee15ea98.slice/crio-e167a3afdce95e77be7e4cbf1a3a88267d1526205bc8c178b264860ad4784d79 WatchSource:0}: Error finding container e167a3afdce95e77be7e4cbf1a3a88267d1526205bc8c178b264860ad4784d79: Status 404 returned error can't find the container with id e167a3afdce95e77be7e4cbf1a3a88267d1526205bc8c178b264860ad4784d79
Sep 09 18:48:28.202556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.202508    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:48:28.202741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.202564    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:48:28.279498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.279446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7771-289376" event={"ID":"0a5c9767-1b36-4199-85bd-d80bee15ea98","Type":"ContainerStarted","Data":"0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f"}
Sep 09 18:48:28.279498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.279502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7771-289376" event={"ID":"0a5c9767-1b36-4199-85bd-d80bee15ea98","Type":"ContainerStarted","Data":"e167a3afdce95e77be7e4cbf1a3a88267d1526205bc8c178b264860ad4784d79"}
Sep 09 18:48:28.280135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.279603    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7771-8e3d0d" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" containerName="test-curl-7771-8e3d0d" containerID="cri-o://c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1" gracePeriod=2
Sep 09 18:48:28.295082 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:28.295032    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7771-289376" podStartSLOduration=1.295016562 podStartE2EDuration="1.295016562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:28.294060306 +0000 UTC m=+1004.156997996" watchObservedRunningTime="2026-09-09 18:48:28.295016562 +0000 UTC m=+1004.157954260"
Sep 09 18:48:28.296178 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:28.296150    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-8e3d0d\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:29.045563 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.045421    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7771-289376"]
Sep 09 18:48:29.048413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.048363    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7771-289376"]
Sep 09 18:48:29.286049 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:29.286012    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7771-289376" container="test-curl-7771-289376"
Sep 09 18:48:29.892215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.892173    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:48:29.892675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.892657    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" containerName="test-curl-7771-289376"
Sep 09 18:48:29.892794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.892678    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" containerName="test-curl-7771-289376"
Sep 09 18:48:29.892794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.892782    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" containerName="test-curl-7771-289376"
Sep 09 18:48:29.895940 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.895920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:29.898801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.898780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-38af9d-openshift-default-dockercfg-594lh\""
Sep 09 18:48:29.912378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:29.912351    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:48:30.015292 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015292 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k2p8\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.015672 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.015604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116726 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2p8\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.116925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117226 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.116996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117226 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117226 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117405 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117405 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117540 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.117874 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.117848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.119330 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.119304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.119453 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.119335    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.125949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.125929    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.126134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.126113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k2p8\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8\") pod \"e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") " pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.205581 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.205494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:30.295932 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.295902    2561 generic.go:356] "Generic (PLEG): container finished" podID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerID="8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9" exitCode=0
Sep 09 18:48:30.296296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.295974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerDied","Data":"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"}
Sep 09 18:48:30.296296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.296188    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7771-289376" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" containerName="test-curl-7771-289376" containerID="cri-o://0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f" gracePeriod=2
Sep 09 18:48:30.296926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.296725    2561 scope.go:117] "RemoveContainer" containerID="8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"
Sep 09 18:48:30.298313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.298090    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.298313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.298190    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.298313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.298239    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.298897 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:30.298562    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-289376\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:30.300642 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:30.300620    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-289376\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:30.503170 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.503140    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:30.505258 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:30.505230    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-289376\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:30.515484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.515459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:48:30.516686 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:30.516660    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7281475_dd51_47e6_b6bd_840f9eb36a0e.slice/crio-98d4ddf50dd213a5ffe1a270a3bc311a87dac42ce85cbdbbe18ffab0274b3b98 WatchSource:0}: Error finding container 98d4ddf50dd213a5ffe1a270a3bc311a87dac42ce85cbdbbe18ffab0274b3b98: Status 404 returned error can't find the container with id 98d4ddf50dd213a5ffe1a270a3bc311a87dac42ce85cbdbbe18ffab0274b3b98
Sep 09 18:48:30.519125 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.519085    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.519228 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.519149    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.519228 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.519178    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:30.622290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.622263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97jvq\" (UniqueName: \"kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq\") pod \"f3ba912b-4e72-41c1-a42d-c77563d4a0d1\" (UID: \"f3ba912b-4e72-41c1-a42d-c77563d4a0d1\") "
Sep 09 18:48:30.624465 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.624433    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq" (OuterVolumeSpecName: "kube-api-access-97jvq") pod "f3ba912b-4e72-41c1-a42d-c77563d4a0d1" (UID: "f3ba912b-4e72-41c1-a42d-c77563d4a0d1"). InnerVolumeSpecName "kube-api-access-97jvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:48:30.724057 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:30.724020    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97jvq\" (UniqueName: \"kubernetes.io/projected/f3ba912b-4e72-41c1-a42d-c77563d4a0d1-kube-api-access-97jvq\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:48:31.308307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.308259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerStarted","Data":"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"}
Sep 09 18:48:31.308860 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.308334    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerStarted","Data":"98d4ddf50dd213a5ffe1a270a3bc311a87dac42ce85cbdbbe18ffab0274b3b98"}
Sep 09 18:48:31.312237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.311957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerStarted","Data":"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"}
Sep 09 18:48:31.313928 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.313900    2561 generic.go:356] "Generic (PLEG): container finished" podID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" containerID="c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1" exitCode=137
Sep 09 18:48:31.314144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.314133    2561 scope.go:117] "RemoveContainer" containerID="c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1"
Sep 09 18:48:31.314424 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.314384    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-8e3d0d"
Sep 09 18:48:31.332087 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.331919    2561 scope.go:117] "RemoveContainer" containerID="c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1"
Sep 09 18:48:31.332277 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:31.332253    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1\": container with ID starting with c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1 not found: ID does not exist" containerID="c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1"
Sep 09 18:48:31.332359 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.332290    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1"} err="failed to get container status \"c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1\": rpc error: code = NotFound desc = could not find container \"c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1\": container with ID starting with c9c629635972a550d81f3515f14951d3150296c2f1f5f5b60d5c008e0d4f3df1 not found: ID does not exist"
Sep 09 18:48:31.332838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.332801    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podStartSLOduration=2.332787783 podStartE2EDuration="2.332787783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:31.33235004 +0000 UTC m=+1007.195287758" watchObservedRunningTime="2026-09-09 18:48:31.332787783 +0000 UTC m=+1007.195725481"
Sep 09 18:48:31.924043 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.924000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:31.924243 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.924188    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:31.924328 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:31.924242    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:32.206083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.205978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:32.210792 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.210767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:32.322184 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.322145    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:32.322958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.322938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:32.614378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.613588    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ba912b-4e72-41c1-a42d-c77563d4a0d1" path="/var/lib/kubelet/pods/f3ba912b-4e72-41c1-a42d-c77563d4a0d1/volumes"
Sep 09 18:48:32.622498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.621819    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:32.748938 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.748833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkrfp\" (UniqueName: \"kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp\") pod \"0a5c9767-1b36-4199-85bd-d80bee15ea98\" (UID: \"0a5c9767-1b36-4199-85bd-d80bee15ea98\") "
Sep 09 18:48:32.762095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.762040    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp" (OuterVolumeSpecName: "kube-api-access-xkrfp") pod "0a5c9767-1b36-4199-85bd-d80bee15ea98" (UID: "0a5c9767-1b36-4199-85bd-d80bee15ea98"). InnerVolumeSpecName "kube-api-access-xkrfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:48:32.850690 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.850650    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkrfp\" (UniqueName: \"kubernetes.io/projected/0a5c9767-1b36-4199-85bd-d80bee15ea98-kube-api-access-xkrfp\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:48:32.923620 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.923557    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:32.923796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:32.923662    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:33.329628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.329525    2561 generic.go:356] "Generic (PLEG): container finished" podID="0a5c9767-1b36-4199-85bd-d80bee15ea98" containerID="0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f" exitCode=137
Sep 09 18:48:33.329628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.329571    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:33.329628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.329623    2561 scope.go:117] "RemoveContainer" containerID="0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f"
Sep 09 18:48:33.342099 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.340970    2561 scope.go:117] "RemoveContainer" containerID="0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f"
Sep 09 18:48:33.344620 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:33.344528    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f\": container with ID starting with 0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f not found: ID does not exist" containerID="0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f"
Sep 09 18:48:33.344620 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:33.344578    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-289376\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:33.344620 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.344589    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f"} err="failed to get container status \"0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f\": rpc error: code = NotFound desc = could not find container \"0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f\": container with ID starting with 0f4273ec0d51c372032bd7b243388051d94f38ba75b2cc44475daab32f9f8d9f not found: ID does not exist"
Sep 09 18:48:33.923752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.923710    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:33.923907 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:33.923784    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:34.608296 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:48:34.608250    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7771-289376\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" pod="opendatahub/test-curl-7771-289376"
Sep 09 18:48:34.609034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:34.609012    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a5c9767-1b36-4199-85bd-d80bee15ea98" path="/var/lib/kubelet/pods/0a5c9767-1b36-4199-85bd-d80bee15ea98/volumes"
Sep 09 18:48:34.923996 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:34.923962    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:34.924158 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:34.924025    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:35.923736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:35.923690    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:35.924284 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:35.923763    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:36.251643 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:36.251545    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:48:36.251643 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:36.251618    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:48:36.923605 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:36.923566    2561 patch_prober.go:28] interesting pod/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 09 18:48:36.923838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:36.923632    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 09 18:48:37.928743 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:37.928714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:37.929215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:37.928994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:37.929862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:37.929843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:48:38.686438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.686375    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:48:38.689932 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.689913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.692204 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.692184    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-77aadf-openshift-default-dockercfg-qmwv7\""
Sep 09 18:48:38.701805 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.701782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:48:38.829271 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lknf6\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829573    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.829696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.829608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.930996 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.930959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lknf6\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.931931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.931863    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.932186 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.932162    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.933619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.933594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.933847 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.933829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.939435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.939344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:38.939435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:38.939376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lknf6\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6\") pod \"e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") " pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:39.001714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.001674    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:39.282902 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.282874    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:48:39.285512 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:39.285487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09901d54_b8b0_4fad_9b9b_24cca9df2dbe.slice/crio-31e7b49ff18ba847a870ad2a3e8aa3835cf9dc7e399cf92c2e91528f69b3b61a WatchSource:0}: Error finding container 31e7b49ff18ba847a870ad2a3e8aa3835cf9dc7e399cf92c2e91528f69b3b61a: Status 404 returned error can't find the container with id 31e7b49ff18ba847a870ad2a3e8aa3835cf9dc7e399cf92c2e91528f69b3b61a
Sep 09 18:48:39.287695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.287663    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.287793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.287742    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.287793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.287786    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.374890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.374858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerStarted","Data":"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"}
Sep 09 18:48:39.375035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.374918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerStarted","Data":"31e7b49ff18ba847a870ad2a3e8aa3835cf9dc7e399cf92c2e91528f69b3b61a"}
Sep 09 18:48:39.376679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.376656    2561 generic.go:356] "Generic (PLEG): container finished" podID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerID="c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca" exitCode=0
Sep 09 18:48:39.376773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.376726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerDied","Data":"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"}
Sep 09 18:48:39.377164 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.377149    2561 scope.go:117] "RemoveContainer" containerID="c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"
Sep 09 18:48:39.378352 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.378320    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.378485 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.378415    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.378485 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.378458    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:39.393363 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:39.393315    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podStartSLOduration=1.39329264 podStartE2EDuration="1.39329264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:39.391116328 +0000 UTC m=+1015.254054048" watchObservedRunningTime="2026-09-09 18:48:39.39329264 +0000 UTC m=+1015.256230339"
Sep 09 18:48:40.002555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:40.002521    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:40.007665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:40.007637    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:40.384508 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:40.384423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerStarted","Data":"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"}
Sep 09 18:48:40.384655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:40.384630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:40.385503 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:40.385482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:48:41.016150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:41.016123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:41.016667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:41.016516    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 09 18:48:41.016727 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:41.016650    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 09 18:48:42.016440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:42.016376    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 09 18:48:42.017058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:42.017021    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 09 18:48:43.016177 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:43.015824    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 09 18:48:43.016177 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:43.015880    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 09 18:48:44.016260 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:44.016216    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 09 18:48:44.016801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:44.016539    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 09 18:48:45.015811 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:45.015774    2561 patch_prober.go:28] interesting pod/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 09 18:48:45.015992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:45.015843    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 09 18:48:46.019779 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.019743    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:46.020191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.020106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:46.021314 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.021292    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:48:46.191433 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.191381    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"]
Sep 09 18:48:46.196495 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.196470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:46.198806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.198783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:48:46.198903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.198881    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:48:46.206600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.206575    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"]
Sep 09 18:48:46.226873 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.226842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j\" (UID: \"df5e801f-7897-42b8-9705-22e8b9f11ef6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:46.327752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.327664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j\" (UID: \"df5e801f-7897-42b8-9705-22e8b9f11ef6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:46.328309 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.328286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j\" (UID: \"df5e801f-7897-42b8-9705-22e8b9f11ef6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:46.509957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.509923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:46.786848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:46.786813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"]
Sep 09 18:48:46.787962 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:48:46.787934    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5e801f_7897_42b8_9705_22e8b9f11ef6.slice/crio-e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a WatchSource:0}: Error finding container e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a: Status 404 returned error can't find the container with id e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a
Sep 09 18:48:47.459887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:47.459846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j" event={"ID":"df5e801f-7897-42b8-9705-22e8b9f11ef6","Type":"ContainerStarted","Data":"e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a"}
Sep 09 18:48:48.364582 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:48.364539    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:48:48.364771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:48.364609    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:48:50.481866 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.481833    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerID="0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997" exitCode=0
Sep 09 18:48:50.482323 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.481919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerDied","Data":"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"}
Sep 09 18:48:50.482493 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.482457    2561 scope.go:117] "RemoveContainer" containerID="0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"
Sep 09 18:48:50.715064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.715022    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:50.715222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.715105    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:50.715222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:50.715138    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:48:51.492475 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:51.492341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j" event={"ID":"df5e801f-7897-42b8-9705-22e8b9f11ef6","Type":"ContainerStarted","Data":"9f311eba7c447073b6082fa0acf8668d2f088b68dd89eb5402af8b71819e615b"}
Sep 09 18:48:51.496161 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:51.496120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerStarted","Data":"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"}
Sep 09 18:48:51.515300 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:51.515243    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j" podStartSLOduration=1.553552676 podStartE2EDuration="5.515223874s" totalImagesPullingTime="3.961671198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:48:51.513156432 +0000 UTC m=+1027.376094130" watchObservedRunningTime="2026-09-09 18:48:51.515223874 +0000 UTC m=+1027.378161570"
Sep 09 18:48:51.871471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:51.871357    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:48:52.205925 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:52.205894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:52.206204 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:52.206181    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 09 18:48:52.206307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:52.206236    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 09 18:48:52.503570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:52.503474    2561 generic.go:356] "Generic (PLEG): container finished" podID="df5e801f-7897-42b8-9705-22e8b9f11ef6" containerID="9f311eba7c447073b6082fa0acf8668d2f088b68dd89eb5402af8b71819e615b" exitCode=0
Sep 09 18:48:52.503943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:52.503560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j" event={"ID":"df5e801f-7897-42b8-9705-22e8b9f11ef6","Type":"ContainerDied","Data":"9f311eba7c447073b6082fa0acf8668d2f088b68dd89eb5402af8b71819e615b"}
Sep 09 18:48:53.205941 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.205903    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 09 18:48:53.206132 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.205958    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 09 18:48:53.689285 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.689258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:53.802150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.802063    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca\") pod \"df5e801f-7897-42b8-9705-22e8b9f11ef6\" (UID: \"df5e801f-7897-42b8-9705-22e8b9f11ef6\") "
Sep 09 18:48:53.802429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.802378    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "df5e801f-7897-42b8-9705-22e8b9f11ef6" (UID: "df5e801f-7897-42b8-9705-22e8b9f11ef6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:48:53.903154 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:53.903116    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df5e801f-7897-42b8-9705-22e8b9f11ef6-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:48:54.206169 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:54.206129    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 09 18:48:54.206354 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:54.206211    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 09 18:48:54.516017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:54.515933    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"
Sep 09 18:48:54.516017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:54.515948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j" event={"ID":"df5e801f-7897-42b8-9705-22e8b9f11ef6","Type":"ContainerDied","Data":"e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a"}
Sep 09 18:48:54.516017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:54.515995    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e75e94863da77263be735e1f25ebf73229cb82f68294ecf4524ebd174b75c14a"
Sep 09 18:48:55.206818 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:55.206777    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 09 18:48:55.207224 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:55.206843    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 09 18:48:56.206838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:56.206793    2561 patch_prober.go:28] interesting pod/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 09 18:48:56.207232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:56.206884    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 09 18:48:57.289881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:57.289846    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:57.290301 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:57.290250    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:48:57.292021 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:48:57.292000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:49:02.807709 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:02.807673    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"]
Sep 09 18:49:02.810043 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:02.810020    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0c2fa5c-rmx9j"]
Sep 09 18:49:02.959648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:02.959609    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:49:02.959888 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:02.959834    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy" containerID="cri-o://1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716" gracePeriod=30
Sep 09 18:49:04.098169 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.098132    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:04.098674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.098569    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5e801f-7897-42b8-9705-22e8b9f11ef6" containerName="revoke-keys"
Sep 09 18:49:04.098674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.098582    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5e801f-7897-42b8-9705-22e8b9f11ef6" containerName="revoke-keys"
Sep 09 18:49:04.098674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.098644    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5e801f-7897-42b8-9705-22e8b9f11ef6" containerName="revoke-keys"
Sep 09 18:49:04.102742 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.102717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.112539 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.112515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b6a21af8-gw-openshift-default-dockercfg-jhwcp\""
Sep 09 18:49:04.127890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.127859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrcgj\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.210523 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.209444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310452 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310452 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310699 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310699 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrcgj\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.310977 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.310997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.311193    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.311200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311444 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.311418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.311574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.311679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.311655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.312876 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.312855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.313090 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.313073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.318835 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.318812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.318835 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.318831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrcgj\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj\") pod \"e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") " pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.413075 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.413037    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:04.610908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.610872    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5e801f-7897-42b8-9705-22e8b9f11ef6" path="/var/lib/kubelet/pods/df5e801f-7897-42b8-9705-22e8b9f11ef6/volumes"
Sep 09 18:49:04.730280 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.730250    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:04.730994 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:49:04.730969    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b697bd_7cd0_413c_a58f_aee593fb3f28.slice/crio-b58a78abf389ac980b2c87216815219cfb358d904a7eca2f1c44a970f0025afc WatchSource:0}: Error finding container b58a78abf389ac980b2c87216815219cfb358d904a7eca2f1c44a970f0025afc: Status 404 returned error can't find the container with id b58a78abf389ac980b2c87216815219cfb358d904a7eca2f1c44a970f0025afc
Sep 09 18:49:04.734332 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.734292    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:04.734450 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.734374    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:04.734450 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:04.734438    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:05.584712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:05.584667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerStarted","Data":"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"}
Sep 09 18:49:05.585095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:05.584780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerStarted","Data":"b58a78abf389ac980b2c87216815219cfb358d904a7eca2f1c44a970f0025afc"}
Sep 09 18:49:05.606105 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:05.606049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podStartSLOduration=1.606034444 podStartE2EDuration="1.606034444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:49:05.60450483 +0000 UTC m=+1041.467442547" watchObservedRunningTime="2026-09-09 18:49:05.606034444 +0000 UTC m=+1041.468972141"
Sep 09 18:49:06.414045 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:06.414011    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:06.419046 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:06.419020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:06.590902 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:06.590861    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:06.591947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:06.591929    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:08.278353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.278324    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:49:08.371342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371312    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371424    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371474    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzvx7\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371624    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371659    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket\") pod \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\" (UID: \"d939f02f-27d9-49c9-ae8a-93ba2f76beb4\") "
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:08.371856 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.371848    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:49:08.372152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:08.372152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372033    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:08.372152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372136    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.372310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372152    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.372310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372165    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.372310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372177    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.372310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.372190    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.373865 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.373839    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:08.373958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.373922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:49:08.373995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.373965    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7" (OuterVolumeSpecName: "kube-api-access-mzvx7") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "kube-api-access-mzvx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:49:08.374042 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.374017    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "d939f02f-27d9-49c9-ae8a-93ba2f76beb4" (UID: "d939f02f-27d9-49c9-ae8a-93ba2f76beb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:49:08.473291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.473255    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.473291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.473284    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.473291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.473294    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzvx7\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-kube-api-access-mzvx7\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.473549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.473304    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d939f02f-27d9-49c9-ae8a-93ba2f76beb4-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:08.606386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.606298    2561 generic.go:356] "Generic (PLEG): container finished" podID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerID="1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716" exitCode=0
Sep 09 18:49:08.606556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.606423    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"
Sep 09 18:49:08.610198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.610175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerDied","Data":"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"}
Sep 09 18:49:08.610331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.610212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx" event={"ID":"d939f02f-27d9-49c9-ae8a-93ba2f76beb4","Type":"ContainerDied","Data":"004aaef22e06d7de3a3539b299abb67272b820c9c5bb52be3f689ca497c36e54"}
Sep 09 18:49:08.610331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.610241    2561 scope.go:117] "RemoveContainer" containerID="1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"
Sep 09 18:49:08.621299 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.621277    2561 scope.go:117] "RemoveContainer" containerID="c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"
Sep 09 18:49:08.630735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.630716    2561 scope.go:117] "RemoveContainer" containerID="1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"
Sep 09 18:49:08.631088 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:49:08.631061    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716\": container with ID starting with 1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716 not found: ID does not exist" containerID="1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"
Sep 09 18:49:08.631153 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.631130    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716"} err="failed to get container status \"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716\": rpc error: code = NotFound desc = could not find container \"1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716\": container with ID starting with 1136f77c9912ca39d93711eac7662add0905a60679d1a6cdcaa4af71865ff716 not found: ID does not exist"
Sep 09 18:49:08.631198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.631155    2561 scope.go:117] "RemoveContainer" containerID="c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"
Sep 09 18:49:08.631476 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:49:08.631451    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca\": container with ID starting with c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca not found: ID does not exist" containerID="c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"
Sep 09 18:49:08.631571 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.631485    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca"} err="failed to get container status \"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca\": rpc error: code = NotFound desc = could not find container \"c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca\": container with ID starting with c1e669069139cf3b8dcea448c7ecef9b6a8f8d35065837cca27c734e8cf662ca not found: ID does not exist"
Sep 09 18:49:08.633357 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.633338    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:49:08.639050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:08.639026    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d0c2fa5c-openshift-default-7c98cf5d84-bb9zx"]
Sep 09 18:49:10.609598 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:10.609563    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" path="/var/lib/kubelet/pods/d939f02f-27d9-49c9-ae8a-93ba2f76beb4/volumes"
Sep 09 18:49:14.201268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.201230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:49:14.647115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.647084    2561 generic.go:356] "Generic (PLEG): container finished" podID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerID="b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8" exitCode=0
Sep 09 18:49:14.647304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.647166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerDied","Data":"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"}
Sep 09 18:49:14.647664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.647648    2561 scope.go:117] "RemoveContainer" containerID="b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"
Sep 09 18:49:14.648730 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.648704    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:14.648787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.648775    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:14.648823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:14.648811    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:15.662149 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:15.662111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerStarted","Data":"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"}
Sep 09 18:49:16.002193 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:16.002090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:49:16.002373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:16.002221    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:16.002373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:16.002283    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:17.002656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:17.002614    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:17.003055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:17.002675    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:18.002308 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:18.002271    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:18.002501 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:18.002327    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:19.002013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:19.001969    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:19.002445 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:19.002028    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:20.002306 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:20.002265    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:20.002746 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:20.002320    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:21.002621 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:21.002583    2561 patch_prober.go:28] interesting pod/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 09 18:49:21.003031 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:21.002639    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 09 18:49:22.007058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:22.007014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:49:22.007545 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:22.007495    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:49:22.008119 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:22.008094    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:49:22.632576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:22.632531    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:49:22.632783 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:22.632606    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:49:24.733207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.733176    2561 generic.go:356] "Generic (PLEG): container finished" podID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerID="b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98" exitCode=0
Sep 09 18:49:24.733660 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.733253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerDied","Data":"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"}
Sep 09 18:49:24.733706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.733682    2561 scope.go:117] "RemoveContainer" containerID="b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"
Sep 09 18:49:24.734816 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.734791    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:24.734875 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.734865    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:24.734911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:24.734894    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:25.743372 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:25.743331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerStarted","Data":"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"}
Sep 09 18:49:26.413236 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:26.413195    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:26.413508 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:26.413482    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 18:49:26.413565 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:26.413536    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 18:49:27.413833 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:27.413689    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 18:49:27.413833 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:27.413755    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 18:49:28.414419 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:28.414359    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 18:49:28.414851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:28.414442    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 18:49:29.413843 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:29.413808    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 18:49:29.414056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:29.413872    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 18:49:30.414150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:30.414105    2561 patch_prober.go:28] interesting pod/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 09 18:49:30.414675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:30.414178    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 09 18:49:31.417039 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:31.417003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:31.417470 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:31.417419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:31.418134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:31.418117    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:32.075730 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.075695    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"]
Sep 09 18:49:32.076114 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.076101    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:32.076161 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.076116    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:32.076197 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.076192    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:32.078986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.078969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:32.081323 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.081303    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:49:32.081448 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.081302    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:49:32.086462 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.086437    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"]
Sep 09 18:49:32.120058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.120022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh\" (UID: \"f0bd294c-24a2-48c7-b405-786811f241d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:32.221453 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.221385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh\" (UID: \"f0bd294c-24a2-48c7-b405-786811f241d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:32.222070 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.222046    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh\" (UID: \"f0bd294c-24a2-48c7-b405-786811f241d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:32.390881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.390853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:32.683967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.683938    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"]
Sep 09 18:49:32.684992 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:49:32.684970    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bd294c_24a2_48c7_b405_786811f241d8.slice/crio-d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef WatchSource:0}: Error finding container d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef: Status 404 returned error can't find the container with id d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef
Sep 09 18:49:32.801190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:32.801158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh" event={"ID":"f0bd294c-24a2-48c7-b405-786811f241d8","Type":"ContainerStarted","Data":"d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef"}
Sep 09 18:49:33.810289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:33.810252    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0bd294c-24a2-48c7-b405-786811f241d8" containerID="f7f35d1027a67ade020176995e51dbd7070a36bd14db1c72572326f2c8c30f75" exitCode=0
Sep 09 18:49:33.810766 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:33.810310    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh" event={"ID":"f0bd294c-24a2-48c7-b405-786811f241d8","Type":"ContainerDied","Data":"f7f35d1027a67ade020176995e51dbd7070a36bd14db1c72572326f2c8c30f75"}
Sep 09 18:49:34.006276 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.006245    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:49:34.552055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.552010    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:49:34.552598 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.552575    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:34.552598 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.552601    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:34.552795 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.552723    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d939f02f-27d9-49c9-ae8a-93ba2f76beb4" containerName="istio-proxy"
Sep 09 18:49:34.556047 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.556015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.558282 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.558256    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:49:34.559643 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.559519    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-38af9d\"/\"kube-root-ca.crt\""
Sep 09 18:49:34.559772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.559693    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-38af9d\"/\"default-dockercfg-72qsg\""
Sep 09 18:49:34.559772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.559768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-38af9d\"/\"openshift-service-ca.crt\""
Sep 09 18:49:34.559900 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.559784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-38af9d\"/\"autores-model-38af9d-kserve-self-signed-certs\""
Sep 09 18:49:34.645377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.645585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.645664 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.645740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.645821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.645877 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.645826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69z6\" (UniqueName: \"kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.746883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.746845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.746890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.746928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.746958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.746982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69z6\" (UniqueName: \"kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.747020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747482 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.747454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.747499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.747546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.747465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.749665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.749634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.749816 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.749645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.754458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.754434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69z6\" (UniqueName: \"kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6\") pod \"autores-model-38af9d-kserve-558bbf4575-sfsvn\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") " pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.877303 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.876372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:34.988881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:34.988844    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:35.055186 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.055150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca\") pod \"f0bd294c-24a2-48c7-b405-786811f241d8\" (UID: \"f0bd294c-24a2-48c7-b405-786811f241d8\") "
Sep 09 18:49:35.055519 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.055497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0bd294c-24a2-48c7-b405-786811f241d8" (UID: "f0bd294c-24a2-48c7-b405-786811f241d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:49:35.055602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.055585    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0bd294c-24a2-48c7-b405-786811f241d8-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:35.166218 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:49:35.166191    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc79f67a2_5f54_4e2c_ab2b_575ead410f16.slice/crio-777b6be0b3fcf69b4b4e1ce7b39f8e3d78aab8e3262e9f6cbc167c3d7b4698e3 WatchSource:0}: Error finding container 777b6be0b3fcf69b4b4e1ce7b39f8e3d78aab8e3262e9f6cbc167c3d7b4698e3: Status 404 returned error can't find the container with id 777b6be0b3fcf69b4b4e1ce7b39f8e3d78aab8e3262e9f6cbc167c3d7b4698e3
Sep 09 18:49:35.166996 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.166925    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:49:35.824363 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.824325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" event={"ID":"c79f67a2-5f54-4e2c-ab2b-575ead410f16","Type":"ContainerStarted","Data":"b96870966ab0c160944226789a952abc559d5828903b4c56161c3d2efe3a4ce7"}
Sep 09 18:49:35.824568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.824374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" event={"ID":"c79f67a2-5f54-4e2c-ab2b-575ead410f16","Type":"ContainerStarted","Data":"777b6be0b3fcf69b4b4e1ce7b39f8e3d78aab8e3262e9f6cbc167c3d7b4698e3"}
Sep 09 18:49:35.825660 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.825639    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"
Sep 09 18:49:35.825751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.825638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh" event={"ID":"f0bd294c-24a2-48c7-b405-786811f241d8","Type":"ContainerDied","Data":"d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef"}
Sep 09 18:49:35.825801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.825763    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5cbdbb8f85c3093c5d96a828214f83983e0f8fb96894a0ee0b901cc123e92ef"
Sep 09 18:49:35.842792 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:35.842743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" podStartSLOduration=1.842727966 podStartE2EDuration="1.842727966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:49:35.841268323 +0000 UTC m=+1071.704206032" watchObservedRunningTime="2026-09-09 18:49:35.842727966 +0000 UTC m=+1071.705665664"
Sep 09 18:49:38.993176 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:38.993095    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"]
Sep 09 18:49:38.996282 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:38.996256    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b6a21af8-hx9wh"]
Sep 09 18:49:39.134749 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.134711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:39.135265 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.135226    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy" containerID="cri-o://90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b" gracePeriod=30
Sep 09 18:49:39.886762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.886720    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:49:39.887220 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.887202    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bd294c-24a2-48c7-b405-786811f241d8" containerName="revoke-keys"
Sep 09 18:49:39.887309 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.887223    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bd294c-24a2-48c7-b405-786811f241d8" containerName="revoke-keys"
Sep 09 18:49:39.887367 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.887341    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bd294c-24a2-48c7-b405-786811f241d8" containerName="revoke-keys"
Sep 09 18:49:39.890821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.890798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:39.893080 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.893060    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-65f3bfa3-openshift-default-dockercfg-5fp9g\""
Sep 09 18:49:39.914340 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:39.914314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:49:40.007071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnf7g\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.007585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.007368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108775 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnf7g\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108931    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.108969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109317 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.108996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109413 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.109359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.109468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109584 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.109561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109991 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.109578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.109991 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.109745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.111435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.111388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.111681 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.111662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.129980 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.129956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnf7g\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.132215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.132196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token\") pod \"e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") " pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.201714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.201664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:40.515474 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.515373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:49:40.523454 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:49:40.523428    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819ca283_bb12_4f18_b720_d63b8d44fb06.slice/crio-ccd568d7feee0f0bce4351ed32509ca31aeb0777d30a5209a1c3250fa80b528f WatchSource:0}: Error finding container ccd568d7feee0f0bce4351ed32509ca31aeb0777d30a5209a1c3250fa80b528f: Status 404 returned error can't find the container with id ccd568d7feee0f0bce4351ed32509ca31aeb0777d30a5209a1c3250fa80b528f
Sep 09 18:49:40.525649 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.525621    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:40.525763 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.525731    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:40.525830 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.525778    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:49:40.611843 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.611802    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0bd294c-24a2-48c7-b405-786811f241d8" path="/var/lib/kubelet/pods/f0bd294c-24a2-48c7-b405-786811f241d8/volumes"
Sep 09 18:49:40.859275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.859182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerStarted","Data":"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"}
Sep 09 18:49:40.859275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.859251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerStarted","Data":"ccd568d7feee0f0bce4351ed32509ca31aeb0777d30a5209a1c3250fa80b528f"}
Sep 09 18:49:40.890971 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:40.890917    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podStartSLOduration=1.8909005859999999 podStartE2EDuration="1.890900586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:49:40.889663964 +0000 UTC m=+1076.752601685" watchObservedRunningTime="2026-09-09 18:49:40.890900586 +0000 UTC m=+1076.753838283"
Sep 09 18:49:41.202592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:41.202554    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:41.204250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:41.204220    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:49:41.204389 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:41.204278    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:49:42.206116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:42.206085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:42.870846 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:42.870813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:42.871802 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:42.871784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:49:44.397836 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.397808    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:44.560924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.560846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.560924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.560897    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.560934    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.560962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.560993    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561037    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrcgj\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561375 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561160    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561375 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data" (OuterVolumeSpecName: "istio-data") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:44.561375 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561204    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket\") pod \"00b697bd-7cd0-413c-a58f-aee593fb3f28\" (UID: \"00b697bd-7cd0-413c-a58f-aee593fb3f28\") "
Sep 09 18:49:44.561568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:44.561568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561420    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:44.561675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561587    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:44.561675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561619    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:49:44.561801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561691    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.561801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561718    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.561801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561733    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.561801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.561747    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.563616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.563587    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:49:44.563745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.563610    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token" (OuterVolumeSpecName: "istio-token") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:49:44.563745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.563636    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj" (OuterVolumeSpecName: "kube-api-access-rrcgj") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "kube-api-access-rrcgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:49:44.563745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.563736    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00b697bd-7cd0-413c-a58f-aee593fb3f28" (UID: "00b697bd-7cd0-413c-a58f-aee593fb3f28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:49:44.662501 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.662474    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.662501 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.662503    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.662736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.662512    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.662736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.662520    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrcgj\" (UniqueName: \"kubernetes.io/projected/00b697bd-7cd0-413c-a58f-aee593fb3f28-kube-api-access-rrcgj\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.662736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.662535    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00b697bd-7cd0-413c-a58f-aee593fb3f28-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:44.876937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.876837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:44.877196 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.877152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:44.885030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.885001    2561 generic.go:356] "Generic (PLEG): container finished" podID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerID="90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b" exitCode=0
Sep 09 18:49:44.885189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.885048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"
Sep 09 18:49:44.885189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.885088    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerDied","Data":"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"}
Sep 09 18:49:44.885189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.885150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj" event={"ID":"00b697bd-7cd0-413c-a58f-aee593fb3f28","Type":"ContainerDied","Data":"b58a78abf389ac980b2c87216815219cfb358d904a7eca2f1c44a970f0025afc"}
Sep 09 18:49:44.885189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.885182    2561 scope.go:117] "RemoveContainer" containerID="90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"
Sep 09 18:49:44.891111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.891086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:44.894692 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.894674    2561 scope.go:117] "RemoveContainer" containerID="b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"
Sep 09 18:49:44.902944 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.902928    2561 scope.go:117] "RemoveContainer" containerID="90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"
Sep 09 18:49:44.903190 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:49:44.903171    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b\": container with ID starting with 90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b not found: ID does not exist" containerID="90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"
Sep 09 18:49:44.903240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.903200    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b"} err="failed to get container status \"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b\": rpc error: code = NotFound desc = could not find container \"90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b\": container with ID starting with 90a4b546336c92ab0af646ed4fc37080df12e2dc0ed40dc7c9323bfbd3edb43b not found: ID does not exist"
Sep 09 18:49:44.903240 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.903217    2561 scope.go:117] "RemoveContainer" containerID="b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"
Sep 09 18:49:44.903476 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:49:44.903459    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98\": container with ID starting with b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98 not found: ID does not exist" containerID="b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"
Sep 09 18:49:44.903536 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.903482    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98"} err="failed to get container status \"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98\": rpc error: code = NotFound desc = could not find container \"b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98\": container with ID starting with b5a8896b629775a44bb75a348c0b3dc503e6bec4026bca83d16229161e3b5a98 not found: ID does not exist"
Sep 09 18:49:44.916030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.916005    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:44.933176 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:44.933149    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b6a21af8-gw-openshift-default-6cc5b49d8d-jwdmj"]
Sep 09 18:49:45.902906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:45.902877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:49:46.609732 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:46.609693    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" path="/var/lib/kubelet/pods/00b697bd-7cd0-413c-a58f-aee593fb3f28/volumes"
Sep 09 18:49:51.939255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:51.939221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:49:53.834547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.834513    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:49:53.971074 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971032    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"]
Sep 09 18:49:53.971735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971712    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.971791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.971791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971765    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.971791 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971775    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.971904 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971887    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.971939 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.971907    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b697bd-7cd0-413c-a58f-aee593fb3f28" containerName="istio-proxy"
Sep 09 18:49:53.977094 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.977070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:53.979914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.979691    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:49:53.981315 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.980191    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:49:53.984784 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:53.984704    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"]
Sep 09 18:49:54.159471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.159440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-38af9d-nshk8\" (UID: \"594494b8-77f2-42cb-b456-2e62a5577c67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:54.260911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.260875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-38af9d-nshk8\" (UID: \"594494b8-77f2-42cb-b456-2e62a5577c67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:54.261880 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.261849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-38af9d-nshk8\" (UID: \"594494b8-77f2-42cb-b456-2e62a5577c67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:54.290625 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.290585    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:54.574331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.574300    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"]
Sep 09 18:49:54.575959 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:49:54.575922    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594494b8_77f2_42cb_b456_2e62a5577c67.slice/crio-2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a WatchSource:0}: Error finding container 2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a: Status 404 returned error can't find the container with id 2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a
Sep 09 18:49:54.952401 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.952347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8" event={"ID":"594494b8-77f2-42cb-b456-2e62a5577c67","Type":"ContainerStarted","Data":"bc5c8401979f7c79aa6fc685771e4b627a7d20c1d4a89a29e124a89298e866dd"}
Sep 09 18:49:54.952796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.952439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8" event={"ID":"594494b8-77f2-42cb-b456-2e62a5577c67","Type":"ContainerStarted","Data":"2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a"}
Sep 09 18:49:54.968631 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:54.968568    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8" podStartSLOduration=1.968547541 podStartE2EDuration="1.968547541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:49:54.968086452 +0000 UTC m=+1090.831024151" watchObservedRunningTime="2026-09-09 18:49:54.968547541 +0000 UTC m=+1090.831485239"
Sep 09 18:49:55.965774 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:55.965257    2561 generic.go:356] "Generic (PLEG): container finished" podID="594494b8-77f2-42cb-b456-2e62a5577c67" containerID="bc5c8401979f7c79aa6fc685771e4b627a7d20c1d4a89a29e124a89298e866dd" exitCode=0
Sep 09 18:49:55.966525 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:55.965741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8" event={"ID":"594494b8-77f2-42cb-b456-2e62a5577c67","Type":"ContainerDied","Data":"bc5c8401979f7c79aa6fc685771e4b627a7d20c1d4a89a29e124a89298e866dd"}
Sep 09 18:49:57.127718 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.127694    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:57.188034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.187997    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca\") pod \"594494b8-77f2-42cb-b456-2e62a5577c67\" (UID: \"594494b8-77f2-42cb-b456-2e62a5577c67\") "
Sep 09 18:49:57.188342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.188318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "594494b8-77f2-42cb-b456-2e62a5577c67" (UID: "594494b8-77f2-42cb-b456-2e62a5577c67"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:49:57.289022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.288936    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/594494b8-77f2-42cb-b456-2e62a5577c67-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:49:57.980440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.980412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"
Sep 09 18:49:57.980634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.980405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8" event={"ID":"594494b8-77f2-42cb-b456-2e62a5577c67","Type":"ContainerDied","Data":"2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a"}
Sep 09 18:49:57.980634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:49:57.980537    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c1ec8a4cf5a7bc2fe5c9129754ea8eecd9989fb0f0caa55b76219e49141108a"
Sep 09 18:50:04.021059 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.020965    2561 generic.go:356] "Generic (PLEG): container finished" podID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerID="20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781" exitCode=0
Sep 09 18:50:04.021598 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.021044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerDied","Data":"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"}
Sep 09 18:50:04.021671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.021619    2561 scope.go:117] "RemoveContainer" containerID="20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"
Sep 09 18:50:04.022776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.022749    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:04.022834 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.022819    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:04.022871 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.022853    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:04.879404 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.879371    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"]
Sep 09 18:50:04.883616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:04.883591    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-38af9d-nshk8"]
Sep 09 18:50:05.031597 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:05.031558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerStarted","Data":"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"}
Sep 09 18:50:05.202015 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:05.201975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:05.202217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:05.202184    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:50:05.202294 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:05.202240    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:50:06.202338 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:06.202304    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:50:06.202733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:06.202369    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:50:06.614127 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:06.614036    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594494b8-77f2-42cb-b456-2e62a5577c67" path="/var/lib/kubelet/pods/594494b8-77f2-42cb-b456-2e62a5577c67/volumes"
Sep 09 18:50:07.202872 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:07.202833    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:50:07.203272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:07.202893    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:50:08.114736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.114699    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"]
Sep 09 18:50:08.115123 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.115111    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594494b8-77f2-42cb-b456-2e62a5577c67" containerName="revoke-keys"
Sep 09 18:50:08.115170 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.115125    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="594494b8-77f2-42cb-b456-2e62a5577c67" containerName="revoke-keys"
Sep 09 18:50:08.115211 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.115200    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="594494b8-77f2-42cb-b456-2e62a5577c67" containerName="revoke-keys"
Sep 09 18:50:08.117190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.117174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:08.119506 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.119483    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:50:08.119630 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.119484    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:50:08.128258 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.128233    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"]
Sep 09 18:50:08.202179 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.202137    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:50:08.202331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.202203    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:50:08.210908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.210873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks\" (UID: \"1362a4f8-90ed-4cf2-bcbd-f8059457c32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:08.311890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.311851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks\" (UID: \"1362a4f8-90ed-4cf2-bcbd-f8059457c32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:08.312599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.312579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks\" (UID: \"1362a4f8-90ed-4cf2-bcbd-f8059457c32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:08.428053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.427998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:08.720272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.720244    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"]
Sep 09 18:50:08.722115 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:50:08.722084    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1362a4f8_90ed_4cf2_bcbd_f8059457c32a.slice/crio-b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0 WatchSource:0}: Error finding container b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0: Status 404 returned error can't find the container with id b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0
Sep 09 18:50:08.868446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:08.868405    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" podUID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" containerName="main" containerID="cri-o://b96870966ab0c160944226789a952abc559d5828903b4c56161c3d2efe3a4ce7" gracePeriod=45
Sep 09 18:50:09.078085 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.078003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks" event={"ID":"1362a4f8-90ed-4cf2-bcbd-f8059457c32a","Type":"ContainerStarted","Data":"b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0"}
Sep 09 18:50:09.080081 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.080048    2561 generic.go:356] "Generic (PLEG): container finished" podID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" containerID="b96870966ab0c160944226789a952abc559d5828903b4c56161c3d2efe3a4ce7" exitCode=0
Sep 09 18:50:09.080205 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.080123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" event={"ID":"c79f67a2-5f54-4e2c-ab2b-575ead410f16","Type":"ContainerDied","Data":"b96870966ab0c160944226789a952abc559d5828903b4c56161c3d2efe3a4ce7"}
Sep 09 18:50:09.134667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.134635    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:50:09.202427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.202380    2561 patch_prober.go:28] interesting pod/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 09 18:50:09.202592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.202470    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 09 18:50:09.221203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.221595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221223    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.221595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.221595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.221595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n69z6\" (UniqueName: \"kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.221595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.221422    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs\") pod \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\" (UID: \"c79f67a2-5f54-4e2c-ab2b-575ead410f16\") "
Sep 09 18:50:09.222093 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.222059    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:09.222194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.222073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home" (OuterVolumeSpecName: "home") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:09.222194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.222094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache" (OuterVolumeSpecName: "model-cache") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:09.223755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.223735    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm" (OuterVolumeSpecName: "dshm") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:09.223755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.223744    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:50:09.224090 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.224073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6" (OuterVolumeSpecName: "kube-api-access-n69z6") pod "c79f67a2-5f54-4e2c-ab2b-575ead410f16" (UID: "c79f67a2-5f54-4e2c-ab2b-575ead410f16"). InnerVolumeSpecName "kube-api-access-n69z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323019    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tls-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323056    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-dshm\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323068    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-model-cache\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323075    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-home\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323083    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c79f67a2-5f54-4e2c-ab2b-575ead410f16-tmp-dir\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:09.323117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:09.323091    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n69z6\" (UniqueName: \"kubernetes.io/projected/c79f67a2-5f54-4e2c-ab2b-575ead410f16-kube-api-access-n69z6\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:10.087821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.087735    2561 generic.go:356] "Generic (PLEG): container finished" podID="1362a4f8-90ed-4cf2-bcbd-f8059457c32a" containerID="3f19b42ededbb5908491bacbefdd08cf99b06d808c4626cd63245f33d0cd2bc6" exitCode=0
Sep 09 18:50:10.087991 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.087830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks" event={"ID":"1362a4f8-90ed-4cf2-bcbd-f8059457c32a","Type":"ContainerDied","Data":"3f19b42ededbb5908491bacbefdd08cf99b06d808c4626cd63245f33d0cd2bc6"}
Sep 09 18:50:10.089510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.089482    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"
Sep 09 18:50:10.089645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.089535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn" event={"ID":"c79f67a2-5f54-4e2c-ab2b-575ead410f16","Type":"ContainerDied","Data":"777b6be0b3fcf69b4b4e1ce7b39f8e3d78aab8e3262e9f6cbc167c3d7b4698e3"}
Sep 09 18:50:10.089645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.089583    2561 scope.go:117] "RemoveContainer" containerID="b96870966ab0c160944226789a952abc559d5828903b4c56161c3d2efe3a4ce7"
Sep 09 18:50:10.130384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.130348    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:50:10.132876 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.132851    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-38af9d/autores-model-38af9d-kserve-558bbf4575-sfsvn"]
Sep 09 18:50:10.291242 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.291209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:10.291751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.291589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:10.292796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.292778    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:10.608476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:10.608442    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" path="/var/lib/kubelet/pods/c79f67a2-5f54-4e2c-ab2b-575ead410f16/volumes"
Sep 09 18:50:11.230508 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:11.230485    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:11.343041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:11.343009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca\") pod \"1362a4f8-90ed-4cf2-bcbd-f8059457c32a\" (UID: \"1362a4f8-90ed-4cf2-bcbd-f8059457c32a\") "
Sep 09 18:50:11.343493 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:11.343465    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1362a4f8-90ed-4cf2-bcbd-f8059457c32a" (UID: "1362a4f8-90ed-4cf2-bcbd-f8059457c32a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:50:11.444870 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:11.444828    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1362a4f8-90ed-4cf2-bcbd-f8059457c32a-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:12.104357 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:12.104326    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"
Sep 09 18:50:12.104522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:12.104359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks" event={"ID":"1362a4f8-90ed-4cf2-bcbd-f8059457c32a","Type":"ContainerDied","Data":"b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0"}
Sep 09 18:50:12.104522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:12.104423    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b023226d33d3538b07346fda2a39d8216204f40264f6da42be27f35376afedf0"
Sep 09 18:50:12.364545 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:12.364440    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:50:12.364942 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:12.364667    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy" containerID="cri-o://40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82" gracePeriod=30
Sep 09 18:50:13.095161 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095130    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:50:13.095621 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095607    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" containerName="main"
Sep 09 18:50:13.095682 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095623    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" containerName="main"
Sep 09 18:50:13.095682 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095641    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1362a4f8-90ed-4cf2-bcbd-f8059457c32a" containerName="revoke-keys"
Sep 09 18:50:13.095682 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095646    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1362a4f8-90ed-4cf2-bcbd-f8059457c32a" containerName="revoke-keys"
Sep 09 18:50:13.095780 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095705    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1362a4f8-90ed-4cf2-bcbd-f8059457c32a" containerName="revoke-keys"
Sep 09 18:50:13.095780 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.095712    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c79f67a2-5f54-4e2c-ab2b-575ead410f16" containerName="main"
Sep 09 18:50:13.097602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.097584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.102899 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.102881    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f8eac9-openshift-default-dockercfg-9vpm5\""
Sep 09 18:50:13.121288 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.121258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:50:13.162102 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162102 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162321 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nmcn\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162458 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.162574 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.162467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.263976 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nmcn\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.264259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.263999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.264259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.264048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.264259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.264082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.264913 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.264883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.265634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.265604    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.265744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.265653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.266019 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.265994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.266306 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.266176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.268703 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.268680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.269936 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.269908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.273618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.273573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.274419 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.274370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nmcn\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn\") pod \"e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") " pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.409358 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.409318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:13.698908 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.698884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:50:13.699972 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:50:13.699931    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d95e97f_7221_48f2_8a6a_77d69034020a.slice/crio-903520baa1a4ebfbd5de88c7574639cb86ba2a3aecf0068bbbf1b995c7712289 WatchSource:0}: Error finding container 903520baa1a4ebfbd5de88c7574639cb86ba2a3aecf0068bbbf1b995c7712289: Status 404 returned error can't find the container with id 903520baa1a4ebfbd5de88c7574639cb86ba2a3aecf0068bbbf1b995c7712289
Sep 09 18:50:13.702386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.702351    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:13.702497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.702450    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:13.702497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:13.702478    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:14.121660 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.121578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerStarted","Data":"b2849ad940c6324597e930dcdd20af9433ffe12a54acd30f71896ca1243b2ed2"}
Sep 09 18:50:14.121660 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.121624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerStarted","Data":"903520baa1a4ebfbd5de88c7574639cb86ba2a3aecf0068bbbf1b995c7712289"}
Sep 09 18:50:14.143634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.143569    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podStartSLOduration=1.143546516 podStartE2EDuration="1.143546516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:50:14.14074151 +0000 UTC m=+1110.003679232" watchObservedRunningTime="2026-09-09 18:50:14.143546516 +0000 UTC m=+1110.006484215"
Sep 09 18:50:14.212137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.212104    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:50:14.409862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.409830    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:14.414648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.414622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:14.554949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.554917    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"]
Sep 09 18:50:14.557729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.557697    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-65f3bfa3-hb5ks"]
Sep 09 18:50:14.610588 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:14.610554    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1362a4f8-90ed-4cf2-bcbd-f8059457c32a" path="/var/lib/kubelet/pods/1362a4f8-90ed-4cf2-bcbd-f8059457c32a/volumes"
Sep 09 18:50:15.128494 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:15.128460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:15.129658 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:15.129639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:15.800469 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:15.800433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:50:15.801254 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:15.801216    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy" containerID="cri-o://2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966" gracePeriod=30
Sep 09 18:50:16.655456 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.655413    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:16.659965 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.659938    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.664034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.664013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-edd73ecc-openshift-default-dockercfg-hjhr2\""
Sep 09 18:50:16.679663 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.679638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:16.810275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.810714 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.810674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2n9\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.911663 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.911566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.911663 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.911622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.911885 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.911742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.911885 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.911791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.911987 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.911908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912104 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912104 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2n9\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912328 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912437 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912521 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.912761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.912739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.914128 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.914107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.914447 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.914427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.927502 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.927474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.927656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.927562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2n9\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9\") pod \"e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") " pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:16.970487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:16.970448    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:17.257557 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.257525    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:17.257959 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:50:17.257937    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18d0109_3a38_4817_a27f_8a1be293fef6.slice/crio-15ea9cb60e1bc5a22748f02591da3171f70ec7f99fc25e6c4f932f5ad43fdc2a WatchSource:0}: Error finding container 15ea9cb60e1bc5a22748f02591da3171f70ec7f99fc25e6c4f932f5ad43fdc2a: Status 404 returned error can't find the container with id 15ea9cb60e1bc5a22748f02591da3171f70ec7f99fc25e6c4f932f5ad43fdc2a
Sep 09 18:50:17.260258 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.260223    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:17.260325 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.260296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:17.260365 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.260329    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:17.637095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.637060    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:50:17.721480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k2p8\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721519    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721550    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721668 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721727    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:17.721967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo\") pod \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\" (UID: \"a7281475-dd51-47e6-b6bd-840f9eb36a0e\") "
Sep 09 18:50:17.721967 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.721947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:17.722244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722129    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:17.722244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:50:17.722356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722267    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.722356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722287    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.722356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722299    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.722356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.722332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:17.724162 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.724138    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:17.724277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.724136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:50:17.724517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.724489    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8" (OuterVolumeSpecName: "kube-api-access-8k2p8") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "kube-api-access-8k2p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:17.724517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.724501    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7281475-dd51-47e6-b6bd-840f9eb36a0e" (UID: "a7281475-dd51-47e6-b6bd-840f9eb36a0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823254    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k2p8\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-kube-api-access-8k2p8\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823285    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823294    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823302    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7281475-dd51-47e6-b6bd-840f9eb36a0e-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823310    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:17.823341 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:17.823318    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7281475-dd51-47e6-b6bd-840f9eb36a0e-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:18.150358 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.150306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerStarted","Data":"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"}
Sep 09 18:50:18.150575 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.150386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerStarted","Data":"15ea9cb60e1bc5a22748f02591da3171f70ec7f99fc25e6c4f932f5ad43fdc2a"}
Sep 09 18:50:18.152350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.152312    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerID="40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82" exitCode=0
Sep 09 18:50:18.152833 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.152568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerDied","Data":"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"}
Sep 09 18:50:18.152933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.152876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx" event={"ID":"a7281475-dd51-47e6-b6bd-840f9eb36a0e","Type":"ContainerDied","Data":"98d4ddf50dd213a5ffe1a270a3bc311a87dac42ce85cbdbbe18ffab0274b3b98"}
Sep 09 18:50:18.152933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.152923    2561 scope.go:117] "RemoveContainer" containerID="40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"
Sep 09 18:50:18.153045 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.152725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"
Sep 09 18:50:18.169298 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.169278    2561 scope.go:117] "RemoveContainer" containerID="0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"
Sep 09 18:50:18.174283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.174231    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podStartSLOduration=2.174208984 podStartE2EDuration="2.174208984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:50:18.172622901 +0000 UTC m=+1114.035560612" watchObservedRunningTime="2026-09-09 18:50:18.174208984 +0000 UTC m=+1114.037146683"
Sep 09 18:50:18.179030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.179011    2561 scope.go:117] "RemoveContainer" containerID="40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"
Sep 09 18:50:18.179323 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:18.179302    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82\": container with ID starting with 40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82 not found: ID does not exist" containerID="40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"
Sep 09 18:50:18.179369 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.179336    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82"} err="failed to get container status \"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82\": rpc error: code = NotFound desc = could not find container \"40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82\": container with ID starting with 40bf1d79df216b0ce1277a0ec63ff6b636cea315fc34bd453e67e05e9b9b6c82 not found: ID does not exist"
Sep 09 18:50:18.179369 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.179355    2561 scope.go:117] "RemoveContainer" containerID="0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"
Sep 09 18:50:18.179636 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:18.179618    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997\": container with ID starting with 0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997 not found: ID does not exist" containerID="0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"
Sep 09 18:50:18.179761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.179637    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997"} err="failed to get container status \"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997\": rpc error: code = NotFound desc = could not find container \"0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997\": container with ID starting with 0b9a24fd6613c6b12b42b21147657bbcaa39de98174ce1da1cadef62aab1c997 not found: ID does not exist"
Sep 09 18:50:18.193047 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.193007    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:50:18.197028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.197001    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-38af9d-openshift-default-679d8f5496-rqpwx"]
Sep 09 18:50:18.613379 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.613288    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" path="/var/lib/kubelet/pods/a7281475-dd51-47e6-b6bd-840f9eb36a0e/volumes"
Sep 09 18:50:18.971043 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.971002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:18.975968 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:18.975935    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:19.160879 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:19.160848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:19.161741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:19.161722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:21.066989 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.066962    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:21.159222 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159190    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159269    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159286    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnf7g\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159451    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159490    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159516    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket\") pod \"819ca283-bb12-4f18-b720-d63b8d44fb06\" (UID: \"819ca283-bb12-4f18-b720-d63b8d44fb06\") "
Sep 09 18:50:21.159880 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:50:21.159880 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:21.159983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:21.160039 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.159990    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.160039 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.160010    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/819ca283-bb12-4f18-b720-d63b8d44fb06-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.160039 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.160018    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:21.160201 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.160046    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data" (OuterVolumeSpecName: "istio-data") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:21.161865 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.161838    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:50:21.162141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.162121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token" (OuterVolumeSpecName: "istio-token") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:21.162258 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.162232    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:21.162360 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.162262    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g" (OuterVolumeSpecName: "kube-api-access-fnf7g") pod "819ca283-bb12-4f18-b720-d63b8d44fb06" (UID: "819ca283-bb12-4f18-b720-d63b8d44fb06"). InnerVolumeSpecName "kube-api-access-fnf7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:21.176958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.176928    2561 generic.go:356] "Generic (PLEG): container finished" podID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerID="2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966" exitCode=0
Sep 09 18:50:21.177083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.176976    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"
Sep 09 18:50:21.177083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.177004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerDied","Data":"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"}
Sep 09 18:50:21.177083 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.177062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h" event={"ID":"819ca283-bb12-4f18-b720-d63b8d44fb06","Type":"ContainerDied","Data":"ccd568d7feee0f0bce4351ed32509ca31aeb0777d30a5209a1c3250fa80b528f"}
Sep 09 18:50:21.177251 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.177084    2561 scope.go:117] "RemoveContainer" containerID="2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"
Sep 09 18:50:21.187493 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.187465    2561 scope.go:117] "RemoveContainer" containerID="20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"
Sep 09 18:50:21.196550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.196443    2561 scope.go:117] "RemoveContainer" containerID="2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"
Sep 09 18:50:21.197250 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:21.197224    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966\": container with ID starting with 2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966 not found: ID does not exist" containerID="2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"
Sep 09 18:50:21.197378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.197255    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966"} err="failed to get container status \"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966\": rpc error: code = NotFound desc = could not find container \"2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966\": container with ID starting with 2d772d42e7a1e6a8e4d22e544292167c94b4dfd3dc0d61e793b3d2f12d6fe966 not found: ID does not exist"
Sep 09 18:50:21.197378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.197273    2561 scope.go:117] "RemoveContainer" containerID="20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"
Sep 09 18:50:21.197621 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:21.197600    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781\": container with ID starting with 20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781 not found: ID does not exist" containerID="20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"
Sep 09 18:50:21.197685 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.197631    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781"} err="failed to get container status \"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781\": rpc error: code = NotFound desc = could not find container \"20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781\": container with ID starting with 20443d5d689e055fcece4b1f9e57e1b233993ee4a8b00aed0c7baee3c765d781 not found: ID does not exist"
Sep 09 18:50:21.199799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.199777    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:50:21.208929 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.208904    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-65f3bfa3-openshift-default-66ffc47d6d-d9c5h"]
Sep 09 18:50:21.261326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261278    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261314    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261328    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261658 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261341    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261658 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261354    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261658 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261366    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnf7g\" (UniqueName: \"kubernetes.io/projected/819ca283-bb12-4f18-b720-d63b8d44fb06-kube-api-access-fnf7g\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:21.261658 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:21.261380    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/819ca283-bb12-4f18-b720-d63b8d44fb06-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:22.609290 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:22.609253    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" path="/var/lib/kubelet/pods/819ca283-bb12-4f18-b720-d63b8d44fb06/volumes"
Sep 09 18:50:31.171588 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:31.171539    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:50:31.172007 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:31.171618    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:50:33.257665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.257629    2561 generic.go:356] "Generic (PLEG): container finished" podID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerID="b2849ad940c6324597e930dcdd20af9433ffe12a54acd30f71896ca1243b2ed2" exitCode=0
Sep 09 18:50:33.258141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.257709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerDied","Data":"b2849ad940c6324597e930dcdd20af9433ffe12a54acd30f71896ca1243b2ed2"}
Sep 09 18:50:33.258141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.258125    2561 scope.go:117] "RemoveContainer" containerID="b2849ad940c6324597e930dcdd20af9433ffe12a54acd30f71896ca1243b2ed2"
Sep 09 18:50:33.259239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.259212    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:33.259304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.259283    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:33.259343 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.259315    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:33.508516 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:33.508428    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:50:34.269778 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:34.269741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerStarted","Data":"e5031b38a41be92e277897874ef65fdcd1ac5ef7c9a0bf50f7c0faa9f259f74e"}
Sep 09 18:50:34.409675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:34.409641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:34.409857 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:34.409842    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:34.409906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:34.409883    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:35.410676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:35.410628    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:35.411171 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:35.410699    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:36.410207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:36.410169    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:36.410415 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:36.410237    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:37.410706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:37.410671    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:37.411115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:37.410726    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:38.410467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:38.410435    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:38.410721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:38.410698    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:39.410027 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:39.409986    2561 patch_prober.go:28] interesting pod/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 09 18:50:39.410545 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:39.410053    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 09 18:50:40.413566 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:40.413533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:40.413958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:40.413942    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:40.414552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:40.414530    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:50:44.350651 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.350551    2561 generic.go:356] "Generic (PLEG): container finished" podID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerID="5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a" exitCode=0
Sep 09 18:50:44.350651 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.350625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerDied","Data":"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"}
Sep 09 18:50:44.351113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.351034    2561 scope.go:117] "RemoveContainer" containerID="5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"
Sep 09 18:50:44.352284 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.352256    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:44.352354 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.352327    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:44.352408 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.352372    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:50:44.724586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.724547    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"]
Sep 09 18:50:44.725213 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725179    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725214    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725244    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725258    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725276    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725289    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725306    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725320    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725479    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.725840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725492    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725503    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="819ca283-bb12-4f18-b720-d63b8d44fb06" containerName="istio-proxy"
Sep 09 18:50:44.725840 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.725516    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7281475-dd51-47e6-b6bd-840f9eb36a0e" containerName="istio-proxy"
Sep 09 18:50:44.729478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.729450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:44.732990 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.732965    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:50:44.733109 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.733033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:50:44.738520 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.738491    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"]
Sep 09 18:50:44.811717 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.811673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7\" (UID: \"360f84f3-4327-4520-9748-660151b9fa4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:44.912586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.912542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7\" (UID: \"360f84f3-4327-4520-9748-660151b9fa4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:44.913440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:44.913407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7\" (UID: \"360f84f3-4327-4520-9748-660151b9fa4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:45.043305 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.043197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:45.364480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.363099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerStarted","Data":"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"}
Sep 09 18:50:45.375457 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.372131    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"]
Sep 09 18:50:45.379159 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:50:45.379121    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360f84f3_4327_4520_9748_660151b9fa4c.slice/crio-12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151 WatchSource:0}: Error finding container 12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151: Status 404 returned error can't find the container with id 12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151
Sep 09 18:50:45.971299 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.971196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:45.972513 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.972482    2561 patch_prober.go:28] interesting pod/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 09 18:50:45.972624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:45.972545    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 09 18:50:46.375819 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:46.375785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7" event={"ID":"360f84f3-4327-4520-9748-660151b9fa4c","Type":"ContainerStarted","Data":"459c64793c1a5efb001b2e8e3851765214aab0a5d62e89e066135dd513096ed8"}
Sep 09 18:50:46.376221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:46.375850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7" event={"ID":"360f84f3-4327-4520-9748-660151b9fa4c","Type":"ContainerStarted","Data":"12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151"}
Sep 09 18:50:46.400815 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:46.400771    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7" podStartSLOduration=2.400754005 podStartE2EDuration="2.400754005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:50:46.400363408 +0000 UTC m=+1142.263301105" watchObservedRunningTime="2026-09-09 18:50:46.400754005 +0000 UTC m=+1142.263691702"
Sep 09 18:50:46.971429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:46.971368    2561 patch_prober.go:28] interesting pod/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 09 18:50:46.971619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:46.971443    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 09 18:50:47.383640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:47.383555    2561 generic.go:356] "Generic (PLEG): container finished" podID="360f84f3-4327-4520-9748-660151b9fa4c" containerID="459c64793c1a5efb001b2e8e3851765214aab0a5d62e89e066135dd513096ed8" exitCode=0
Sep 09 18:50:47.384000 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:47.383645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7" event={"ID":"360f84f3-4327-4520-9748-660151b9fa4c","Type":"ContainerDied","Data":"459c64793c1a5efb001b2e8e3851765214aab0a5d62e89e066135dd513096ed8"}
Sep 09 18:50:47.971132 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:47.971091    2561 patch_prober.go:28] interesting pod/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 09 18:50:47.971306 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:47.971151    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 09 18:50:48.536953 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.536927    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:48.664463 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.662804    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca\") pod \"360f84f3-4327-4520-9748-660151b9fa4c\" (UID: \"360f84f3-4327-4520-9748-660151b9fa4c\") "
Sep 09 18:50:48.664463 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.663435    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "360f84f3-4327-4520-9748-660151b9fa4c" (UID: "360f84f3-4327-4520-9748-660151b9fa4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:50:48.764245 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.764199    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/360f84f3-4327-4520-9748-660151b9fa4c-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:48.971333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.971239    2561 patch_prober.go:28] interesting pod/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 09 18:50:48.971333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:48.971302    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 09 18:50:49.161629 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.161585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:49.397214 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.397182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7" event={"ID":"360f84f3-4327-4520-9748-660151b9fa4c","Type":"ContainerDied","Data":"12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151"}
Sep 09 18:50:49.397214 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.397208    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"
Sep 09 18:50:49.397442 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.397232    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12e90df5d4462d0c28560e0146d6409cdff19410d18ef28986c3de8cb3ff0151"
Sep 09 18:50:49.971785 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.971743    2561 patch_prober.go:28] interesting pod/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 09 18:50:49.972194 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:49.971806    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 09 18:50:50.975117 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:50.975082    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:50.976440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:50.976417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:52.175832 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:52.175785    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"]
Sep 09 18:50:52.180504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:52.180473    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-edd73ecc-hxbk7"]
Sep 09 18:50:52.351852 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:52.351817    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:52.414926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:52.414883    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy" containerID="cri-o://fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb" gracePeriod=30
Sep 09 18:50:52.609947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:52.609866    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="360f84f3-4327-4520-9748-660151b9fa4c" path="/var/lib/kubelet/pods/360f84f3-4327-4520-9748-660151b9fa4c/volumes"
Sep 09 18:50:53.290848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:53.290805    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:50:57.669756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.669726    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:57.752741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752654    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.752741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752710    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.752741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752756    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls2n9\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752804    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752839    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.752887    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token\") pod \"a18d0109-3a38-4817-a27f-8a1be293fef6\" (UID: \"a18d0109-3a38-4817-a27f-8a1be293fef6\") "
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753140    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data" (OuterVolumeSpecName: "istio-data") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753179    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753283    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.753331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753302    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.753733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.753414    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:50:57.755195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.755172    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:57.755302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.755227    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:50:57.755302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.755256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:50:57.755302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.755263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9" (OuterVolumeSpecName: "kube-api-access-ls2n9") pod "a18d0109-3a38-4817-a27f-8a1be293fef6" (UID: "a18d0109-3a38-4817-a27f-8a1be293fef6"). InnerVolumeSpecName "kube-api-access-ls2n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:50:57.853783 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853748    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.853783 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853776    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.853783 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853785    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls2n9\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-kube-api-access-ls2n9\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.854013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853796    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.854013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853805    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.854013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853812    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d0109-3a38-4817-a27f-8a1be293fef6-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:57.854013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:57.853820    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d0109-3a38-4817-a27f-8a1be293fef6-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:50:58.452493 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.452454    2561 generic.go:356] "Generic (PLEG): container finished" podID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerID="fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb" exitCode=0
Sep 09 18:50:58.452665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.452510    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"
Sep 09 18:50:58.452665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.452532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerDied","Data":"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"}
Sep 09 18:50:58.452665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.452589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9" event={"ID":"a18d0109-3a38-4817-a27f-8a1be293fef6","Type":"ContainerDied","Data":"15ea9cb60e1bc5a22748f02591da3171f70ec7f99fc25e6c4f932f5ad43fdc2a"}
Sep 09 18:50:58.452665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.452614    2561 scope.go:117] "RemoveContainer" containerID="fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"
Sep 09 18:50:58.463049 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.463029    2561 scope.go:117] "RemoveContainer" containerID="5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"
Sep 09 18:50:58.471379 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.471356    2561 scope.go:117] "RemoveContainer" containerID="fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"
Sep 09 18:50:58.471687 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:58.471666    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb\": container with ID starting with fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb not found: ID does not exist" containerID="fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"
Sep 09 18:50:58.471745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.471696    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb"} err="failed to get container status \"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb\": rpc error: code = NotFound desc = could not find container \"fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb\": container with ID starting with fef02464ee1a7929b25783957e5865192d181c83f44301ee396e0eb08e5232eb not found: ID does not exist"
Sep 09 18:50:58.471745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.471716    2561 scope.go:117] "RemoveContainer" containerID="5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"
Sep 09 18:50:58.471946 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:50:58.471928    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a\": container with ID starting with 5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a not found: ID does not exist" containerID="5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"
Sep 09 18:50:58.472005 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.471956    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a"} err="failed to get container status \"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a\": rpc error: code = NotFound desc = could not find container \"5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a\": container with ID starting with 5cdd302469dee2f6269fe589f2cbe89ab76c034256ed4da3ce852d090e9a833a not found: ID does not exist"
Sep 09 18:50:58.475891 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.475866    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:58.481576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.481554    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-edd73ecc-openshift-default-6cd5446fb-k26k9"]
Sep 09 18:50:58.609745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:50:58.609701    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" path="/var/lib/kubelet/pods/a18d0109-3a38-4817-a27f-8a1be293fef6/volumes"
Sep 09 18:51:05.120753 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:05.120715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:51:10.163569 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163483    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"]
Sep 09 18:51:10.163942 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163933    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.163985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163948    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.163985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163966    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360f84f3-4327-4520-9748-660151b9fa4c" containerName="revoke-keys"
Sep 09 18:51:10.163985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163974    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="360f84f3-4327-4520-9748-660151b9fa4c" containerName="revoke-keys"
Sep 09 18:51:10.164073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163986    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.164073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.163995    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.164073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.164070    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.164167 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.164078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18d0109-3a38-4817-a27f-8a1be293fef6" containerName="istio-proxy"
Sep 09 18:51:10.164167 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.164086    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="360f84f3-4327-4520-9748-660151b9fa4c" containerName="revoke-keys"
Sep 09 18:51:10.168619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.168600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:10.171712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.171686    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:51:10.172457 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.172437    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:51:10.178591 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.178562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"]
Sep 09 18:51:10.266790 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.266754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9\" (UID: \"e6597761-19cc-4e38-bad3-844bd51b0b90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:10.367854 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.367810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9\" (UID: \"e6597761-19cc-4e38-bad3-844bd51b0b90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:10.368487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.368464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9\" (UID: \"e6597761-19cc-4e38-bad3-844bd51b0b90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:10.480438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.480333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:10.762250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:10.762068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"]
Sep 09 18:51:10.765699 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:51:10.765671    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6597761_19cc_4e38_bad3_844bd51b0b90.slice/crio-c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655 WatchSource:0}: Error finding container c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655: Status 404 returned error can't find the container with id c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655
Sep 09 18:51:11.538728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:11.538692    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6597761-19cc-4e38-bad3-844bd51b0b90" containerID="7cc6ede54b421e00ba4b75817df739c1564a3374f6b0b1f8dfb2d9577526d053" exitCode=0
Sep 09 18:51:11.539125 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:11.538763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9" event={"ID":"e6597761-19cc-4e38-bad3-844bd51b0b90","Type":"ContainerDied","Data":"7cc6ede54b421e00ba4b75817df739c1564a3374f6b0b1f8dfb2d9577526d053"}
Sep 09 18:51:11.539125 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:11.538812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9" event={"ID":"e6597761-19cc-4e38-bad3-844bd51b0b90","Type":"ContainerStarted","Data":"c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655"}
Sep 09 18:51:12.688682 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:12.688652    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:12.789950 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:12.789910    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca\") pod \"e6597761-19cc-4e38-bad3-844bd51b0b90\" (UID: \"e6597761-19cc-4e38-bad3-844bd51b0b90\") "
Sep 09 18:51:12.790268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:12.790242    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6597761-19cc-4e38-bad3-844bd51b0b90" (UID: "e6597761-19cc-4e38-bad3-844bd51b0b90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:51:12.890982 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:12.890950    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6597761-19cc-4e38-bad3-844bd51b0b90-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:13.556694 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:13.556663    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"
Sep 09 18:51:13.556897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:13.556701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9" event={"ID":"e6597761-19cc-4e38-bad3-844bd51b0b90","Type":"ContainerDied","Data":"c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655"}
Sep 09 18:51:13.556897 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:13.556748    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c028f38b467d22d1302e16a04960fb050083db008fd5b9fab327dfa0e4e34655"
Sep 09 18:51:19.317050 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:19.317010    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:51:20.988428 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:20.988375    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"]
Sep 09 18:51:20.993881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:20.993854    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f8eac9-jxqn9"]
Sep 09 18:51:22.611115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:22.611081    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6597761-19cc-4e38-bad3-844bd51b0b90" path="/var/lib/kubelet/pods/e6597761-19cc-4e38-bad3-844bd51b0b90/volumes"
Sep 09 18:51:28.497882 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:28.497848    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:51:28.498267 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:28.498066    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy" containerID="cri-o://e5031b38a41be92e277897874ef65fdcd1ac5ef7c9a0bf50f7c0faa9f259f74e" gracePeriod=30
Sep 09 18:51:29.386131 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.386090    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:51:29.386538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.386523    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6597761-19cc-4e38-bad3-844bd51b0b90" containerName="revoke-keys"
Sep 09 18:51:29.386591 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.386539    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6597761-19cc-4e38-bad3-844bd51b0b90" containerName="revoke-keys"
Sep 09 18:51:29.386632 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.386619    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6597761-19cc-4e38-bad3-844bd51b0b90" containerName="revoke-keys"
Sep 09 18:51:29.390769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.390748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.393068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.393045    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-c5cdc4-openshift-default-dockercfg-fcjvr\""
Sep 09 18:51:29.406677 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.406650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:51:29.551272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551272 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7hz\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.551721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.551686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652561 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7hz\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.652769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653227 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.652785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.653293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.653475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.653547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.653602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.653652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.653618    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.655103 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.655081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.655779 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.655759    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.662053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.662029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.663901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.663873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7hz\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz\") pod \"e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") " pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:29.710798 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:29.710754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:30.029641 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.029608    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:51:30.031601 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:51:30.031573    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70499cc_24d6_461b_97a2_f96b275ba735.slice/crio-34f958f76f264b05b4d259e398047ff38db62bbe5afdee70a608c866fba33fb7 WatchSource:0}: Error finding container 34f958f76f264b05b4d259e398047ff38db62bbe5afdee70a608c866fba33fb7: Status 404 returned error can't find the container with id 34f958f76f264b05b4d259e398047ff38db62bbe5afdee70a608c866fba33fb7
Sep 09 18:51:30.033916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.033885    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:51:30.033984 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.033950    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:51:30.034025 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.033981    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:51:30.667547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.667509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" event={"ID":"c70499cc-24d6-461b-97a2-f96b275ba735","Type":"ContainerStarted","Data":"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"}
Sep 09 18:51:30.668010 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.667570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" event={"ID":"c70499cc-24d6-461b-97a2-f96b275ba735","Type":"ContainerStarted","Data":"34f958f76f264b05b4d259e398047ff38db62bbe5afdee70a608c866fba33fb7"}
Sep 09 18:51:30.711412 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.711352    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:30.716481 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:30.716425    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" podStartSLOduration=1.716403502 podStartE2EDuration="1.716403502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:51:30.715408574 +0000 UTC m=+1186.578346296" watchObservedRunningTime="2026-09-09 18:51:30.716403502 +0000 UTC m=+1186.579341191"
Sep 09 18:51:31.716793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:31.716758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:32.680883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:32.680854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:32.682269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:32.682246    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:33.691960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.691926    2561 generic.go:356] "Generic (PLEG): container finished" podID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerID="e5031b38a41be92e277897874ef65fdcd1ac5ef7c9a0bf50f7c0faa9f259f74e" exitCode=0
Sep 09 18:51:33.692437 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.692002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerDied","Data":"e5031b38a41be92e277897874ef65fdcd1ac5ef7c9a0bf50f7c0faa9f259f74e"}
Sep 09 18:51:33.692437 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.692085    2561 scope.go:117] "RemoveContainer" containerID="b2849ad940c6324597e930dcdd20af9433ffe12a54acd30f71896ca1243b2ed2"
Sep 09 18:51:33.755541 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.755515    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:51:33.898012 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.897978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898208    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898301    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nmcn\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898312    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:33.898471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898382    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert\") pod \"1d95e97f-7221-48f2-8a6a-77d69034020a\" (UID: \"1d95e97f-7221-48f2-8a6a-77d69034020a\") "
Sep 09 18:51:33.898734 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:33.898734 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898663    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:33.898846 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898774    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:33.898906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898876    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:33.898906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898881    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:51:33.898906 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898897    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:33.899064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898910    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:33.899064 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.898923    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:33.900411 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.900370    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:33.900522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.900420    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:51:33.900522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.900471    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn" (OuterVolumeSpecName: "kube-api-access-5nmcn") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "kube-api-access-5nmcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:51:33.900522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.900514    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d95e97f-7221-48f2-8a6a-77d69034020a" (UID: "1d95e97f-7221-48f2-8a6a-77d69034020a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:51:33.999939 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.999898    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:33.999939 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.999933    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nmcn\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-kube-api-access-5nmcn\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:34.000148 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.999947    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d95e97f-7221-48f2-8a6a-77d69034020a-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:34.000148 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.999960    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:34.000148 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:33.999971    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d95e97f-7221-48f2-8a6a-77d69034020a-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:34.618739 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.618712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:51:34.699762 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.699727    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"
Sep 09 18:51:34.700217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.699757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g" event={"ID":"1d95e97f-7221-48f2-8a6a-77d69034020a","Type":"ContainerDied","Data":"903520baa1a4ebfbd5de88c7574639cb86ba2a3aecf0068bbbf1b995c7712289"}
Sep 09 18:51:34.700217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.699826    2561 scope.go:117] "RemoveContainer" containerID="e5031b38a41be92e277897874ef65fdcd1ac5ef7c9a0bf50f7c0faa9f259f74e"
Sep 09 18:51:34.734315 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.734259    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:51:34.736805 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:34.736780    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f8eac9-openshift-default-68ccf584dd-xlb8g"]
Sep 09 18:51:36.609068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:36.609023    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" path="/var/lib/kubelet/pods/1d95e97f-7221-48f2-8a6a-77d69034020a/volumes"
Sep 09 18:51:44.645256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:44.645228    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:51:44.650189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:44.650167    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:51:48.123250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:48.123217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:51:53.382539 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.382497    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"]
Sep 09 18:51:53.382949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.382908    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.382949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.382923    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.382949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.382938    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.382949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.382945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.383100 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.383014    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.383100 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.383023    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d95e97f-7221-48f2-8a6a-77d69034020a" containerName="istio-proxy"
Sep 09 18:51:53.387197 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.387177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:53.389721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.389689    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:51:53.389838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.389734    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:51:53.395604 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.395584    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"]
Sep 09 18:51:53.481281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.481243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm\" (UID: \"0ae32fd1-0138-4a7f-88d1-382965479a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:53.582486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.582441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm\" (UID: \"0ae32fd1-0138-4a7f-88d1-382965479a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:53.583071 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.583049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm\" (UID: \"0ae32fd1-0138-4a7f-88d1-382965479a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:53.699487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.699454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:53.973943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:53.973916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"]
Sep 09 18:51:53.975109 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:51:53.975082    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae32fd1_0138_4a7f_88d1_382965479a65.slice/crio-0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8 WatchSource:0}: Error finding container 0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8: Status 404 returned error can't find the container with id 0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8
Sep 09 18:51:54.388628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:54.388542    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:51:54.389049 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:54.388745    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" podUID="c70499cc-24d6-461b-97a2-f96b275ba735" containerName="istio-proxy" containerID="cri-o://73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51" gracePeriod=30
Sep 09 18:51:54.829048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:54.829014    2561 generic.go:356] "Generic (PLEG): container finished" podID="0ae32fd1-0138-4a7f-88d1-382965479a65" containerID="acc20872d4428f6bdade0b8a95983d441fd1e6396cb76e15d1e67f60f8faa880" exitCode=0
Sep 09 18:51:54.829221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:54.829085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm" event={"ID":"0ae32fd1-0138-4a7f-88d1-382965479a65","Type":"ContainerDied","Data":"acc20872d4428f6bdade0b8a95983d441fd1e6396cb76e15d1e67f60f8faa880"}
Sep 09 18:51:54.829221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:54.829123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm" event={"ID":"0ae32fd1-0138-4a7f-88d1-382965479a65","Type":"ContainerStarted","Data":"0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8"}
Sep 09 18:51:55.965275 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:55.965249    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:56.003526 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.003490    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca\") pod \"0ae32fd1-0138-4a7f-88d1-382965479a65\" (UID: \"0ae32fd1-0138-4a7f-88d1-382965479a65\") "
Sep 09 18:51:56.003948 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.003912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ae32fd1-0138-4a7f-88d1-382965479a65" (UID: "0ae32fd1-0138-4a7f-88d1-382965479a65"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:51:56.105225 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.105136    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae32fd1-0138-4a7f-88d1-382965479a65-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:56.841995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.841965    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"
Sep 09 18:51:56.842179 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.841961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm" event={"ID":"0ae32fd1-0138-4a7f-88d1-382965479a65","Type":"ContainerDied","Data":"0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8"}
Sep 09 18:51:56.842179 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:56.842098    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d4e9bddbc8e2d3154a2b42d802b4b0e8c2198c35a44b4101e57fd23d1416dd8"
Sep 09 18:51:59.667492 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.667466    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:59.739411 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739471    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl7hz\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739521    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:59.739799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.739799 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739762    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.740015 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket\") pod \"c70499cc-24d6-461b-97a2-f96b275ba735\" (UID: \"c70499cc-24d6-461b-97a2-f96b275ba735\") "
Sep 09 18:51:59.740015 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.739913    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:51:59.740115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740081    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:59.740115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740095    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data" (OuterVolumeSpecName: "istio-data") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:59.740515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740413    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:59.740515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740423    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.740515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740455    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.740515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740471    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.740515 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.740484    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c70499cc-24d6-461b-97a2-f96b275ba735-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.742268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.742233    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz" (OuterVolumeSpecName: "kube-api-access-nl7hz") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "kube-api-access-nl7hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:51:59.742268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.742261    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:51:59.742468 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.742268    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token" (OuterVolumeSpecName: "istio-token") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:51:59.742572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.742549    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c70499cc-24d6-461b-97a2-f96b275ba735" (UID: "c70499cc-24d6-461b-97a2-f96b275ba735"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:51:59.841914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.841873    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.841914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.841906    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl7hz\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-kube-api-access-nl7hz\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.841914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.841917    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c70499cc-24d6-461b-97a2-f96b275ba735-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.841914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.841925    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c70499cc-24d6-461b-97a2-f96b275ba735-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.842273 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.841933    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c70499cc-24d6-461b-97a2-f96b275ba735-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:51:59.862872 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.862839    2561 generic.go:356] "Generic (PLEG): container finished" podID="c70499cc-24d6-461b-97a2-f96b275ba735" containerID="73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51" exitCode=0
Sep 09 18:51:59.863053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.862881    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"
Sep 09 18:51:59.863053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.862932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" event={"ID":"c70499cc-24d6-461b-97a2-f96b275ba735","Type":"ContainerDied","Data":"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"}
Sep 09 18:51:59.863053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.862992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6" event={"ID":"c70499cc-24d6-461b-97a2-f96b275ba735","Type":"ContainerDied","Data":"34f958f76f264b05b4d259e398047ff38db62bbe5afdee70a608c866fba33fb7"}
Sep 09 18:51:59.863053 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.863026    2561 scope.go:117] "RemoveContainer" containerID="73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"
Sep 09 18:51:59.877645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.877619    2561 scope.go:117] "RemoveContainer" containerID="73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"
Sep 09 18:51:59.878023 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:51:59.877997    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51\": container with ID starting with 73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51 not found: ID does not exist" containerID="73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"
Sep 09 18:51:59.878115 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.878033    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51"} err="failed to get container status \"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51\": rpc error: code = NotFound desc = could not find container \"73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51\": container with ID starting with 73c939c6403adec4f3070aafdf09ed964fd35e73996f0aea23c3d7466b50cd51 not found: ID does not exist"
Sep 09 18:51:59.895635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.895606    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:51:59.907122 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:51:59.907062    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-c5cdc4-openshift-default-666f8c7868-7jmf6"]
Sep 09 18:52:00.136838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:00.136800    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:00.609035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:00.608997    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70499cc-24d6-461b-97a2-f96b275ba735" path="/var/lib/kubelet/pods/c70499cc-24d6-461b-97a2-f96b275ba735/volumes"
Sep 09 18:52:04.269170 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:04.269140    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"]
Sep 09 18:52:04.275522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:04.275493    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-90f815-r5fhm"]
Sep 09 18:52:04.610116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:04.610035    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae32fd1-0138-4a7f-88d1-382965479a65" path="/var/lib/kubelet/pods/0ae32fd1-0138-4a7f-88d1-382965479a65/volumes"
Sep 09 18:52:06.923752 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:06.923721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:11.015779 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.015737    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:52:11.016259 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.016007    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy" containerID="cri-o://0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5" gracePeriod=30
Sep 09 18:52:11.427112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427074    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"]
Sep 09 18:52:11.427518 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427504    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae32fd1-0138-4a7f-88d1-382965479a65" containerName="revoke-keys"
Sep 09 18:52:11.427570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427519    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae32fd1-0138-4a7f-88d1-382965479a65" containerName="revoke-keys"
Sep 09 18:52:11.427570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427531    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70499cc-24d6-461b-97a2-f96b275ba735" containerName="istio-proxy"
Sep 09 18:52:11.427570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427537    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70499cc-24d6-461b-97a2-f96b275ba735" containerName="istio-proxy"
Sep 09 18:52:11.427665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427619    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae32fd1-0138-4a7f-88d1-382965479a65" containerName="revoke-keys"
Sep 09 18:52:11.427665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.427629    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70499cc-24d6-461b-97a2-f96b275ba735" containerName="istio-proxy"
Sep 09 18:52:11.437113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.437082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:11.442097 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.442072    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:52:11.442291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.442173    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:52:11.444609 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.444586    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"]
Sep 09 18:52:11.546671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.546636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz\" (UID: \"c5661208-afd3-47f5-87e3-14ff97775a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:11.647670 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.647635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz\" (UID: \"c5661208-afd3-47f5-87e3-14ff97775a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:11.648269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.648250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz\" (UID: \"c5661208-afd3-47f5-87e3-14ff97775a5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:11.749427 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:11.749301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:12.024665 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:12.024632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"]
Sep 09 18:52:12.025988 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:52:12.025961    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5661208_afd3_47f5_87e3_14ff97775a5c.slice/crio-2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200 WatchSource:0}: Error finding container 2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200: Status 404 returned error can't find the container with id 2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200
Sep 09 18:52:12.945229 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:12.945191    2561 generic.go:356] "Generic (PLEG): container finished" podID="c5661208-afd3-47f5-87e3-14ff97775a5c" containerID="281842b22799a5bea3c17afbf39478c1ef0a65e975a07d5d2fbc8de1133ee671" exitCode=0
Sep 09 18:52:12.945420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:12.945278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz" event={"ID":"c5661208-afd3-47f5-87e3-14ff97775a5c","Type":"ContainerDied","Data":"281842b22799a5bea3c17afbf39478c1ef0a65e975a07d5d2fbc8de1133ee671"}
Sep 09 18:52:12.945420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:12.945329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz" event={"ID":"c5661208-afd3-47f5-87e3-14ff97775a5c","Type":"ContainerStarted","Data":"2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200"}
Sep 09 18:52:14.085382 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.085354    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:14.171628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.171598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca\") pod \"c5661208-afd3-47f5-87e3-14ff97775a5c\" (UID: \"c5661208-afd3-47f5-87e3-14ff97775a5c\") "
Sep 09 18:52:14.171950 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.171927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5661208-afd3-47f5-87e3-14ff97775a5c" (UID: "c5661208-afd3-47f5-87e3-14ff97775a5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:52:14.273380 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.273291    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5661208-afd3-47f5-87e3-14ff97775a5c-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:14.958674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.958639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz" event={"ID":"c5661208-afd3-47f5-87e3-14ff97775a5c","Type":"ContainerDied","Data":"2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200"}
Sep 09 18:52:14.958674 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.958667    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"
Sep 09 18:52:14.958887 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:14.958686    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fad2c2a39746f81503eb1374f084a8fd5aa601e8aa4c79901d11f66a503c200"
Sep 09 18:52:16.274754 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.274729    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:52:16.395068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395039    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395096    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m8m6\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395181    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395236    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395309    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395337    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395371    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs\") pod \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\" (UID: \"295615c0-4e5b-4f36-890e-c4ca4b6cb645\") "
Sep 09 18:52:16.395696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395467    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data" (OuterVolumeSpecName: "istio-data") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:16.395696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395535    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:16.395696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395555    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:16.395696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395665    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:16.395911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395702    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:52:16.395911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395771    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.395911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395788    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.395911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395801    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.395911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.395815    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.397346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.397319    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6" (OuterVolumeSpecName: "kube-api-access-4m8m6") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "kube-api-access-4m8m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:52:16.397500 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.397416    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token" (OuterVolumeSpecName: "istio-token") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:52:16.397500 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.397472    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:16.397642 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.397624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "295615c0-4e5b-4f36-890e-c4ca4b6cb645" (UID: "295615c0-4e5b-4f36-890e-c4ca4b6cb645"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:52:16.496634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.496598    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.496634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.496628    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.496634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.496637    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m8m6\" (UniqueName: \"kubernetes.io/projected/295615c0-4e5b-4f36-890e-c4ca4b6cb645-kube-api-access-4m8m6\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.496882 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.496646    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.496882 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.496655    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295615c0-4e5b-4f36-890e-c4ca4b6cb645-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:16.973357 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.973322    2561 generic.go:356] "Generic (PLEG): container finished" podID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerID="0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5" exitCode=0
Sep 09 18:52:16.973586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.973355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerDied","Data":"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"}
Sep 09 18:52:16.973586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.973386    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"
Sep 09 18:52:16.973586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.973479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4" event={"ID":"295615c0-4e5b-4f36-890e-c4ca4b6cb645","Type":"ContainerDied","Data":"8607622705c7c279f52ab0ef2f77ae6ebe2ba0782030067db8bacfb8bdc73e91"}
Sep 09 18:52:16.973586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.973513    2561 scope.go:117] "RemoveContainer" containerID="0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"
Sep 09 18:52:16.982755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.982738    2561 scope.go:117] "RemoveContainer" containerID="8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"
Sep 09 18:52:16.990953 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.990937    2561 scope.go:117] "RemoveContainer" containerID="0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"
Sep 09 18:52:16.991243 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:52:16.991216    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5\": container with ID starting with 0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5 not found: ID does not exist" containerID="0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"
Sep 09 18:52:16.991320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.991256    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5"} err="failed to get container status \"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5\": rpc error: code = NotFound desc = could not find container \"0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5\": container with ID starting with 0358e52ad8ef703f0980a2ff0e5a1e5427e8df4cf4267910502e1c684ea1e4f5 not found: ID does not exist"
Sep 09 18:52:16.991320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.991279    2561 scope.go:117] "RemoveContainer" containerID="8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"
Sep 09 18:52:16.991547 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:52:16.991529    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9\": container with ID starting with 8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9 not found: ID does not exist" containerID="8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"
Sep 09 18:52:16.991597 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:16.991553    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9"} err="failed to get container status \"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9\": rpc error: code = NotFound desc = could not find container \"8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9\": container with ID starting with 8bc977d067a70d47ff26b32a8ed18746920f32c3afd31fc916edcc0d6a1d4eb9 not found: ID does not exist"
Sep 09 18:52:17.015561 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:17.015531    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:52:17.017876 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:17.017852    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-90f815-openshift-default-ccc7d6648-rgxq4"]
Sep 09 18:52:18.609677 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:18.609645    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" path="/var/lib/kubelet/pods/295615c0-4e5b-4f36-890e-c4ca4b6cb645/volumes"
Sep 09 18:52:21.003076 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:21.003038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:22.243486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:22.243436    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"]
Sep 09 18:52:22.245907 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:22.245882    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-77aadf-fkcpz"]
Sep 09 18:52:22.608833 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:22.608749    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5661208-afd3-47f5-87e3-14ff97775a5c" path="/var/lib/kubelet/pods/c5661208-afd3-47f5-87e3-14ff97775a5c/volumes"
Sep 09 18:52:29.046577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:29.046470    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:52:29.047113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:29.046751    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy" containerID="cri-o://59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50" gracePeriod=30
Sep 09 18:52:29.536496 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:29.536458    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:30.101914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.101880    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 18:52:30.102296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102251    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5661208-afd3-47f5-87e3-14ff97775a5c" containerName="revoke-keys"
Sep 09 18:52:30.102296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102262    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5661208-afd3-47f5-87e3-14ff97775a5c" containerName="revoke-keys"
Sep 09 18:52:30.102296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102288    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102294    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102306    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102312    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102364    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102373    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="295615c0-4e5b-4f36-890e-c4ca4b6cb645" containerName="istio-proxy"
Sep 09 18:52:30.102455 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.102380    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5661208-afd3-47f5-87e3-14ff97775a5c" containerName="revoke-keys"
Sep 09 18:52:30.107015 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.106992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.111135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.111113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-282de3-openshift-default-dockercfg-z8c2g\""
Sep 09 18:52:30.125052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125160 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125453 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trwdr\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.125453 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.125423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.128716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.128694    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 18:52:30.226304 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trwdr\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226602 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226692 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.226952 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.226915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.227147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.227123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.227256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.227127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.227420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.227382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.229123 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.229096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.229246 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.229142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.234701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.234680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.234811 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.234723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trwdr\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr\") pod \"e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") " pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.417225 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.417183    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:30.698899 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.698872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 18:52:30.700629 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:52:30.700600    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafe9a2b_2637_4c0c_b894_86cab115a73e.slice/crio-fde764e78274004c4b918965b9790752a7e296560f23da862be8556687309419 WatchSource:0}: Error finding container fde764e78274004c4b918965b9790752a7e296560f23da862be8556687309419: Status 404 returned error can't find the container with id fde764e78274004c4b918965b9790752a7e296560f23da862be8556687309419
Sep 09 18:52:30.702765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.702738    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:30.702864 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.702800    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:30.702864 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:30.702829    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:31.068326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:31.068228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerStarted","Data":"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"}
Sep 09 18:52:31.068326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:31.068302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerStarted","Data":"fde764e78274004c4b918965b9790752a7e296560f23da862be8556687309419"}
Sep 09 18:52:31.097337 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:31.097284    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podStartSLOduration=1.097267009 podStartE2EDuration="1.097267009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:52:31.0942618 +0000 UTC m=+1246.957199524" watchObservedRunningTime="2026-09-09 18:52:31.097267009 +0000 UTC m=+1246.960204708"
Sep 09 18:52:31.417508 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:31.417474    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:31.422278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:31.422254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:32.074037 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.074001    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:32.075113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.075088    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:32.887983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.887946    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:52:32.891514 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.891490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.893824 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.893798    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ddaae1a6-openshift-default-dockercfg-dxwf2\""
Sep 09 18:52:32.912673 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.906137    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:52:32.950025 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.949992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-427b2\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:32.950351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:32.950300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051376 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051586 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-427b2\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.051851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.052056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051900    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.052056 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.051946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.052196 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.052176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.052351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.052334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.054313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.054290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.054479 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.054458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.059116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.059094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.059583 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.059564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-427b2\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2\") pod \"e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") " pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.202957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.202922    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:33.486000 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.485968    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:52:33.486723 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:52:33.486682    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ce1357_63e3_473c_b02d_6ce0b14c62e7.slice/crio-18a432654a3d4671d129303252e523a24b3604b45e1782b20ec5714e67fb9b75 WatchSource:0}: Error finding container 18a432654a3d4671d129303252e523a24b3604b45e1782b20ec5714e67fb9b75: Status 404 returned error can't find the container with id 18a432654a3d4671d129303252e523a24b3604b45e1782b20ec5714e67fb9b75
Sep 09 18:52:33.489409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.489320    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:33.489504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.489482    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:33.489546 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:33.489534    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:34.087482 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.087451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerStarted","Data":"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"}
Sep 09 18:52:34.087892 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.087515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerStarted","Data":"18a432654a3d4671d129303252e523a24b3604b45e1782b20ec5714e67fb9b75"}
Sep 09 18:52:34.125126 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.125076    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podStartSLOduration=2.125059824 podStartE2EDuration="2.125059824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:52:34.124986002 +0000 UTC m=+1249.987923719" watchObservedRunningTime="2026-09-09 18:52:34.125059824 +0000 UTC m=+1249.987997522"
Sep 09 18:52:34.203557 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.203522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:34.208741 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.208710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:34.296720 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.296697    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:52:34.366166 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366078    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366166 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366230    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366263    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lknf6\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366364    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366426 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366422    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert\") pod \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\" (UID: \"09901d54-b8b0-4fad-9b9b-24cca9df2dbe\") "
Sep 09 18:52:34.366745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366540    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:34.366745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366565    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data" (OuterVolumeSpecName: "istio-data") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:34.366924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366887    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.366924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366907    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.366924 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.366882    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:52:34.367215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.367140    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:34.367215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.367157    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:34.368716 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.368687    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token" (OuterVolumeSpecName: "istio-token") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:52:34.369134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.369106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:52:34.369255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.369148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:52:34.369326 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.369260    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6" (OuterVolumeSpecName: "kube-api-access-lknf6") pod "09901d54-b8b0-4fad-9b9b-24cca9df2dbe" (UID: "09901d54-b8b0-4fad-9b9b-24cca9df2dbe"). InnerVolumeSpecName "kube-api-access-lknf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:52:34.468175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468141    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468168    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468177    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468505 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468186    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lknf6\" (UniqueName: \"kubernetes.io/projected/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-kube-api-access-lknf6\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468505 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468195    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468505 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468203    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:34.468505 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:34.468212    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09901d54-b8b0-4fad-9b9b-24cca9df2dbe-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:52:35.097537 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097497    2561 generic.go:356] "Generic (PLEG): container finished" podID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerID="59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50" exitCode=0
Sep 09 18:52:35.097537 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097543    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"
Sep 09 18:52:35.098098 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerDied","Data":"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"}
Sep 09 18:52:35.098098 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097642    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv" event={"ID":"09901d54-b8b0-4fad-9b9b-24cca9df2dbe","Type":"ContainerDied","Data":"31e7b49ff18ba847a870ad2a3e8aa3835cf9dc7e399cf92c2e91528f69b3b61a"}
Sep 09 18:52:35.098098 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097677    2561 scope.go:117] "RemoveContainer" containerID="59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"
Sep 09 18:52:35.098098 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.097987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:35.099810 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.099758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:35.107878 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.107859    2561 scope.go:117] "RemoveContainer" containerID="b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"
Sep 09 18:52:35.116689 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.116670    2561 scope.go:117] "RemoveContainer" containerID="59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"
Sep 09 18:52:35.116974 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:52:35.116954    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50\": container with ID starting with 59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50 not found: ID does not exist" containerID="59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"
Sep 09 18:52:35.117018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.116985    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50"} err="failed to get container status \"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50\": rpc error: code = NotFound desc = could not find container \"59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50\": container with ID starting with 59d42db23486ed5b7daaec001c520eb22b17f6fcdbf228e7615a47f075fd4a50 not found: ID does not exist"
Sep 09 18:52:35.117018 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.117013    2561 scope.go:117] "RemoveContainer" containerID="b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"
Sep 09 18:52:35.117268 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:52:35.117251    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8\": container with ID starting with b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8 not found: ID does not exist" containerID="b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"
Sep 09 18:52:35.117313 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.117275    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8"} err="failed to get container status \"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8\": rpc error: code = NotFound desc = could not find container \"b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8\": container with ID starting with b4197645aa1e45c1106c510e7704f9bdf76e2cc909bbe0b8c14270645da9afc8 not found: ID does not exist"
Sep 09 18:52:35.122452 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.122429    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:52:35.126582 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:35.126563    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-77aadf-openshift-default-58f58dcb4-h24jv"]
Sep 09 18:52:36.609298 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:36.609263    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" path="/var/lib/kubelet/pods/09901d54-b8b0-4fad-9b9b-24cca9df2dbe/volumes"
Sep 09 18:52:37.132935 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:37.132900    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:47.446849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:47.440107    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": read tcp 10.133.0.2:55928->10.133.0.69:15021: read: connection reset by peer" start-of-body=
Sep 09 18:52:47.446849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:47.440176    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": read tcp 10.133.0.2:55928->10.133.0.69:15021: read: connection reset by peer"
Sep 09 18:52:48.188238 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.188202    2561 generic.go:356] "Generic (PLEG): container finished" podID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerID="b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa" exitCode=0
Sep 09 18:52:48.188451 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.188277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerDied","Data":"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"}
Sep 09 18:52:48.188736 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.188719    2561 scope.go:117] "RemoveContainer" containerID="b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"
Sep 09 18:52:48.189986 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.189959    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:48.190058 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.190040    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:48.190105 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:48.190085    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:49.004670 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:49.004631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:52:49.199823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:49.199782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerStarted","Data":"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"}
Sep 09 18:52:49.417477 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:49.417444    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:49.417859 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:49.417833    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:49.418179 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:49.418152    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:50.417804 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:50.417767    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:50.418209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:50.417846    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:51.139630 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:51.139572    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:52:51.139853 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:51.139669    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:52:51.418607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:51.418570    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:51.418998 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:51.418640    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:52.417943 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:52.417902    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:52.418152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:52.417979    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:53.417706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:53.417668    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:53.419993 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:53.417735    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:54.234944 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.234911    2561 generic.go:356] "Generic (PLEG): container finished" podID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerID="2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a" exitCode=0
Sep 09 18:52:54.235131 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.234980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerDied","Data":"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"}
Sep 09 18:52:54.235388 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.235373    2561 scope.go:117] "RemoveContainer" containerID="2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"
Sep 09 18:52:54.236494 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.236467    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:54.236560 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.236548    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:54.236601 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.236581    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:54.418280 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.418242    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 09 18:52:54.418753 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:54.418312    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 09 18:52:55.245377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:55.245330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerStarted","Data":"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"}
Sep 09 18:52:55.421919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:55.421889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:55.422323 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:55.422176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:55.422874 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:55.422856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 18:52:56.203635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:56.203592    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:52:56.203838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:56.203817    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 09 18:52:56.203893 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:56.203874    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 09 18:52:57.203345 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:57.203307    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 09 18:52:57.203769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:57.203381    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 09 18:52:58.204152 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:58.204115    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 09 18:52:58.204676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:58.204643    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 09 18:52:59.067428 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.066952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071648    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071683    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071710    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071720    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071850    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.073144 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.071864    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="09901d54-b8b0-4fad-9b9b-24cca9df2dbe" containerName="istio-proxy"
Sep 09 18:52:59.075653 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.075635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.079210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.079187    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-0e012d-openshift-default-dockercfg-r8gpc\""
Sep 09 18:52:59.090663 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.090639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 18:52:59.204023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.203988    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 09 18:52:59.204199 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.204047    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 09 18:52:59.223950 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.223920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224072 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.223972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224072 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224072 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcls6\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224525 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.224525 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.224320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325545 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325545 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcls6\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.325801 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.325697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.326175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.326073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.326237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.326165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.326293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.326236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.326293 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.326253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.326814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.326786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.328002 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.327978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.328108 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.328002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.335312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.335290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.335638 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.335614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcls6\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6\") pod \"e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") " pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.387729 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.387691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:52:59.692435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.692405    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 18:52:59.694133 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:52:59.694104    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd110e7ef_1e58_4e61_80e5_008bd0edc043.slice/crio-c1645a4274571b70aae3a57d4393f7bcb2f5555a2dd5ce63711e234bb9203394 WatchSource:0}: Error finding container c1645a4274571b70aae3a57d4393f7bcb2f5555a2dd5ce63711e234bb9203394: Status 404 returned error can't find the container with id c1645a4274571b70aae3a57d4393f7bcb2f5555a2dd5ce63711e234bb9203394
Sep 09 18:52:59.696865 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.696832    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:59.696969 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.696938    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:52:59.697034 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:52:59.696988    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:00.203982 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.203947    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 09 18:53:00.204189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.204003    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 09 18:53:00.284826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.284789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerStarted","Data":"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"}
Sep 09 18:53:00.284826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.284846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerStarted","Data":"c1645a4274571b70aae3a57d4393f7bcb2f5555a2dd5ce63711e234bb9203394"}
Sep 09 18:53:00.322733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.322673    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podStartSLOduration=1.322655355 podStartE2EDuration="1.322655355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:53:00.321453877 +0000 UTC m=+1276.184391598" watchObservedRunningTime="2026-09-09 18:53:00.322655355 +0000 UTC m=+1276.185593053"
Sep 09 18:53:00.388113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.388065    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:00.393606 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:00.393574    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:01.207368 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:01.207334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:53:01.207656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:01.207626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:53:01.208206 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:01.208190    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:53:01.291634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:01.291590    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:01.292534 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:01.292514    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:08.411429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:08.411373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:53:09.022483 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.022444    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"]
Sep 09 18:53:09.027950 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.027915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:09.031289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.031260    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:53:09.031803 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.031779    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:53:09.033627 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.033599    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"]
Sep 09 18:53:09.128384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.128341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j\" (UID: \"88e2d9da-f2a2-41b9-8024-01c20c7a9049\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:09.229013 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.228979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j\" (UID: \"88e2d9da-f2a2-41b9-8024-01c20c7a9049\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:09.229647 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.229626    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j\" (UID: \"88e2d9da-f2a2-41b9-8024-01c20c7a9049\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:09.344266 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.344168    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:09.615869 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:09.615840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"]
Sep 09 18:53:09.617429 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:53:09.617383    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e2d9da_f2a2_41b9_8024_01c20c7a9049.slice/crio-d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef WatchSource:0}: Error finding container d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef: Status 404 returned error can't find the container with id d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef
Sep 09 18:53:10.355138 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:10.355031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j" event={"ID":"88e2d9da-f2a2-41b9-8024-01c20c7a9049","Type":"ContainerStarted","Data":"ce3b4c40acb27e8da9cf1bf8c02801bc1328e75c2d8fa01d4593aefbb84002ea"}
Sep 09 18:53:10.355418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:10.355380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j" event={"ID":"88e2d9da-f2a2-41b9-8024-01c20c7a9049","Type":"ContainerStarted","Data":"d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef"}
Sep 09 18:53:11.367316 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:11.367276    2561 generic.go:356] "Generic (PLEG): container finished" podID="88e2d9da-f2a2-41b9-8024-01c20c7a9049" containerID="ce3b4c40acb27e8da9cf1bf8c02801bc1328e75c2d8fa01d4593aefbb84002ea" exitCode=0
Sep 09 18:53:11.367989 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:11.367961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j" event={"ID":"88e2d9da-f2a2-41b9-8024-01c20c7a9049","Type":"ContainerDied","Data":"ce3b4c40acb27e8da9cf1bf8c02801bc1328e75c2d8fa01d4593aefbb84002ea"}
Sep 09 18:53:12.527133 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:12.527109    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:12.672510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:12.672474    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca\") pod \"88e2d9da-f2a2-41b9-8024-01c20c7a9049\" (UID: \"88e2d9da-f2a2-41b9-8024-01c20c7a9049\") "
Sep 09 18:53:12.672845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:12.672813    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88e2d9da-f2a2-41b9-8024-01c20c7a9049" (UID: "88e2d9da-f2a2-41b9-8024-01c20c7a9049"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:53:12.773129 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:12.773090    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88e2d9da-f2a2-41b9-8024-01c20c7a9049-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:13.382191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:13.382164    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"
Sep 09 18:53:13.382191 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:13.382186    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j" event={"ID":"88e2d9da-f2a2-41b9-8024-01c20c7a9049","Type":"ContainerDied","Data":"d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef"}
Sep 09 18:53:13.382440 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:13.382231    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1beb8bd1566114afc600e0841e9bed2a7e1bc0553f2e40dfa1cd4dcc052dcef"
Sep 09 18:53:17.333558 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:17.333505    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 18:53:17.333937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:17.333582    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 18:53:19.428960 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.428922    2561 generic.go:356] "Generic (PLEG): container finished" podID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerID="5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d" exitCode=0
Sep 09 18:53:19.429439 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.428965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerDied","Data":"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"}
Sep 09 18:53:19.429498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.429457    2561 scope.go:117] "RemoveContainer" containerID="5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"
Sep 09 18:53:19.430787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.430735    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:19.430894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.430851    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:19.430937 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.430913    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:19.872947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.872862    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"]
Sep 09 18:53:19.876706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:19.876677    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ddaae1a6-hdn8j"]
Sep 09 18:53:20.438414 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:20.438359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerStarted","Data":"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"}
Sep 09 18:53:20.609137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:20.609102    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e2d9da-f2a2-41b9-8024-01c20c7a9049" path="/var/lib/kubelet/pods/88e2d9da-f2a2-41b9-8024-01c20c7a9049/volumes"
Sep 09 18:53:21.388761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:21.388721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:21.388987 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:21.388961    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 09 18:53:21.389041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:21.389011    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 09 18:53:22.388883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:22.388846    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 09 18:53:22.389269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:22.388902    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 09 18:53:23.388351 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:23.388312    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 09 18:53:23.388572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:23.388378    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 09 18:53:24.388562 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:24.388524    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 09 18:53:24.389012 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:24.388585    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 09 18:53:24.636116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:24.636078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:53:25.388637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:25.388591    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 09 18:53:25.389173 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:25.388693    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 09 18:53:26.392156 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:26.392121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:26.392656 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:26.392419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:26.393177 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:26.393158    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 18:53:26.647802 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:26.647714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:53:26.648285 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:26.648247    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" containerID="cri-o://07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769" gracePeriod=30
Sep 09 18:53:31.210121 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.210079    2561 patch_prober.go:28] interesting pod/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 18:53:31.210695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.210161    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 18:53:31.901881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.901855    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:53:31.957237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957157    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957249    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957269    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957352    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-427b2\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957376    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token\") pod \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\" (UID: \"b8ce1357-63e3-473c-b02d-6ce0b14c62e7\") "
Sep 09 18:53:31.957556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957473    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:53:31.957922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957576    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:53:31.957922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957591    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:53:31.957922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:53:31.957922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957917    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:31.958134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957939    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:31.958134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957954    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:31.958134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.957967    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:31.958294 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.958147    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:53:31.959667 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.959634    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:53:31.959784 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.959667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2" (OuterVolumeSpecName: "kube-api-access-427b2") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "kube-api-access-427b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:53:31.959784 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.959733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:53:31.959946 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:31.959928    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8ce1357-63e3-473c-b02d-6ce0b14c62e7" (UID: "b8ce1357-63e3-473c-b02d-6ce0b14c62e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:53:32.058905 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.058853    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:32.058905 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.058898    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:32.058905 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.058909    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-427b2\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-kube-api-access-427b2\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:32.058905 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.058919    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:32.059192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.058928    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ce1357-63e3-473c-b02d-6ce0b14c62e7-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:53:32.531849 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.531812    2561 generic.go:356] "Generic (PLEG): container finished" podID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerID="07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769" exitCode=0
Sep 09 18:53:32.532278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.531872    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"
Sep 09 18:53:32.532278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.531893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerDied","Data":"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"}
Sep 09 18:53:32.532278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.531946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2" event={"ID":"b8ce1357-63e3-473c-b02d-6ce0b14c62e7","Type":"ContainerDied","Data":"18a432654a3d4671d129303252e523a24b3604b45e1782b20ec5714e67fb9b75"}
Sep 09 18:53:32.532278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.531969    2561 scope.go:117] "RemoveContainer" containerID="07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"
Sep 09 18:53:32.542497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.542474    2561 scope.go:117] "RemoveContainer" containerID="2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"
Sep 09 18:53:32.551032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.551010    2561 scope.go:117] "RemoveContainer" containerID="07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"
Sep 09 18:53:32.551301 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:53:32.551280    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769\": container with ID starting with 07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769 not found: ID does not exist" containerID="07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"
Sep 09 18:53:32.551347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.551310    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769"} err="failed to get container status \"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769\": rpc error: code = NotFound desc = could not find container \"07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769\": container with ID starting with 07177a29d714cdf16584fc2822ce5b170bbe52a4495546ff0bfa3ffee2778769 not found: ID does not exist"
Sep 09 18:53:32.551347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.551327    2561 scope.go:117] "RemoveContainer" containerID="2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"
Sep 09 18:53:32.551585 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:53:32.551567    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a\": container with ID starting with 2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a not found: ID does not exist" containerID="2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"
Sep 09 18:53:32.551644 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.551597    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a"} err="failed to get container status \"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a\": rpc error: code = NotFound desc = could not find container \"2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a\": container with ID starting with 2eba69c686333650f258b16557fd85f7ecb5de9116a985b98b013da1df45ac6a not found: ID does not exist"
Sep 09 18:53:32.557101 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.557078    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:53:32.561782 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.561761    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ddaae1a6-openshift-default-5f8ff6f57b-gbkc2"]
Sep 09 18:53:32.609467 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:32.609434    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" path="/var/lib/kubelet/pods/b8ce1357-63e3-473c-b02d-6ce0b14c62e7/volumes"
Sep 09 18:53:34.534936 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:34.534901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:53:40.942977 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.942944    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 18:53:40.943362 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943354    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e2d9da-f2a2-41b9-8024-01c20c7a9049" containerName="revoke-keys"
Sep 09 18:53:40.943418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943366    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e2d9da-f2a2-41b9-8024-01c20c7a9049" containerName="revoke-keys"
Sep 09 18:53:40.943418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943374    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.943418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943379    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.943418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943403    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.943418 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943410    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.943577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943478    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.943577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943488    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e2d9da-f2a2-41b9-8024-01c20c7a9049" containerName="revoke-keys"
Sep 09 18:53:40.943577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.943496    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ce1357-63e3-473c-b02d-6ce0b14c62e7" containerName="istio-proxy"
Sep 09 18:53:40.948016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.947995    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:40.950384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.950360    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-0daf23-openshift-default-dockercfg-m2c68\""
Sep 09 18:53:40.969032 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:40.969009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 18:53:41.058422 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.058862 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.059019 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.058859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmtl\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.159821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmtl\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.159983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160452 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160521 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160521 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.160619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.160581    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.162513 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.162490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.162630 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.162531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.168172 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.168143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmtl\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.168172 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.168159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token\") pod \"e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") " pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.258203 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.258108    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:41.537781 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.537747    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 18:53:41.538758 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:53:41.538722    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a3c347_c2e3_4540_8f70_bea7f0b63e06.slice/crio-967f5a7fd428d221bf34040f828d9776719d81db0cb65dd6ad1244d0afba1fe9 WatchSource:0}: Error finding container 967f5a7fd428d221bf34040f828d9776719d81db0cb65dd6ad1244d0afba1fe9: Status 404 returned error can't find the container with id 967f5a7fd428d221bf34040f828d9776719d81db0cb65dd6ad1244d0afba1fe9
Sep 09 18:53:41.541163 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.541127    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:41.541255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.541205    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:41.541255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.541241    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:53:41.590637 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:41.590608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerStarted","Data":"967f5a7fd428d221bf34040f828d9776719d81db0cb65dd6ad1244d0afba1fe9"}
Sep 09 18:53:42.598809 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:42.598775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerStarted","Data":"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"}
Sep 09 18:53:42.619652 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:42.619606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podStartSLOduration=2.6195914350000002 podStartE2EDuration="2.619591435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:53:42.617548982 +0000 UTC m=+1318.480486696" watchObservedRunningTime="2026-09-09 18:53:42.619591435 +0000 UTC m=+1318.482529133"
Sep 09 18:53:43.258430 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:43.258379    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:43.264118 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:43.264090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:43.604718 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:43.604623    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:43.605533 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:43.605514    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:53:50.996177 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:53:50.996133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:54:02.731745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.731712    2561 generic.go:356] "Generic (PLEG): container finished" podID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerID="fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048" exitCode=0
Sep 09 18:54:02.732207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.731783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerDied","Data":"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"}
Sep 09 18:54:02.732207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.732196    2561 scope.go:117] "RemoveContainer" containerID="fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"
Sep 09 18:54:02.733281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.733253    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:02.733384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.733337    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:02.733499 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:02.733383    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:03.740167 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:03.740118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerStarted","Data":"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"}
Sep 09 18:54:04.259744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:04.259263    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:54:04.259744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:04.259422    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 18:54:04.259744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:04.259474    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 18:54:05.258890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:05.258851    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 18:54:05.259489 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:05.259451    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 18:54:05.803957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:05.803923    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:54:06.259068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:06.259030    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 18:54:06.259705 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:06.259672    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 18:54:07.258987 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:07.258890    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 18:54:07.258987 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:07.258967    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 18:54:08.259501 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:08.259457    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 09 18:54:08.260022 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:08.259529    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 09 18:54:09.263250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:09.263215    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:54:09.263651 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:09.263582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:54:09.264257 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:09.264239    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 18:54:10.448651 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.448618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 18:54:10.452457 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.452432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.454962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.454924    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c09a03-openshift-default-dockercfg-v2xrm\""
Sep 09 18:54:10.463373 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.463350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 18:54:10.540155 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540333 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmfsp\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.540680 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.540549    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.641917 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.641885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.642744 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.642699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.643036 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.643274 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.643514 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.643706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmfsp\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.643951 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.644076 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.644288 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.644484 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.643697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.644684 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.644911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.645028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.645134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.644940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.658217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.658175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.664215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.660743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.664215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.661211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.664215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.664137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmfsp\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp\") pod \"e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") " pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:10.765127 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:10.765038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:11.046462 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.046432    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 18:54:11.049019 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:11.048995    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c732887_971e_4b02_8d4c_8c4165718e56.slice/crio-d6843d7e670265f409357187e6eb2da77b460652d2c50f35f133c8cc6acd270a WatchSource:0}: Error finding container d6843d7e670265f409357187e6eb2da77b460652d2c50f35f133c8cc6acd270a: Status 404 returned error can't find the container with id d6843d7e670265f409357187e6eb2da77b460652d2c50f35f133c8cc6acd270a
Sep 09 18:54:11.051709 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.051668    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:11.051796 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.051765    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:11.051841 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.051812    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:11.805232 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.805199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerStarted","Data":"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"}
Sep 09 18:54:11.805702 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.805251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerStarted","Data":"d6843d7e670265f409357187e6eb2da77b460652d2c50f35f133c8cc6acd270a"}
Sep 09 18:54:11.826997 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:11.826950    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podStartSLOduration=1.8269370299999999 podStartE2EDuration="1.82693703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:11.824498759 +0000 UTC m=+1347.687436468" watchObservedRunningTime="2026-09-09 18:54:11.82693703 +0000 UTC m=+1347.689874728"
Sep 09 18:54:12.765811 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:12.765771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:12.770804 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:12.770775    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:12.811876 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:12.811846    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:12.812757 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:12.812735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:22.114734 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:22.114693    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:54:31.937569 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.937531    2561 generic.go:356] "Generic (PLEG): container finished" podID="1c732887-971e-4b02-8d4c-8c4165718e56" containerID="2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc" exitCode=0
Sep 09 18:54:31.937985 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.937608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerDied","Data":"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"}
Sep 09 18:54:31.938111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.938095    2561 scope.go:117] "RemoveContainer" containerID="2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"
Sep 09 18:54:31.939294 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.939267    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:31.939366 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.939335    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:31.939435 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:31.939367    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:32.954555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:32.954516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerStarted","Data":"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"}
Sep 09 18:54:33.765379 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:33.765328    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:33.765735 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:33.765556    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 09 18:54:33.765919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:33.765885    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 09 18:54:34.765916 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:34.765866    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 09 18:54:34.766349 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:34.765964    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 09 18:54:35.766446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:35.766359    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 09 18:54:35.766884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:35.766476    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 09 18:54:36.766376 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:36.766321    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 09 18:54:36.766593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:36.766417    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 09 18:54:37.766030 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:37.765994    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 09 18:54:37.766228 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:37.766056    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 09 18:54:38.770078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:38.770045    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:38.770567 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:38.770331    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:38.771038 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:38.771018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 18:54:39.647010 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.646968    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7759-382217"]
Sep 09 18:54:39.649529 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.649506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:39.652441 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.652418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s9dww\""
Sep 09 18:54:39.656782 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.656760    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-382217"]
Sep 09 18:54:39.731210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.731173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8r8c\" (UniqueName: \"kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c\") pod \"test-curl-7759-382217\" (UID: \"dd2e78bd-3c19-4065-b7e7-a7a992f29004\") " pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:39.832644 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.832597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8r8c\" (UniqueName: \"kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c\") pod \"test-curl-7759-382217\" (UID: \"dd2e78bd-3c19-4065-b7e7-a7a992f29004\") " pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:39.841501 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.841468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8r8c\" (UniqueName: \"kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c\") pod \"test-curl-7759-382217\" (UID: \"dd2e78bd-3c19-4065-b7e7-a7a992f29004\") " pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:39.960957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:39.960871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:40.240318 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:40.240287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-382217"]
Sep 09 18:54:40.242304 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:40.242278    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2e78bd_3c19_4065_b7e7_a7a992f29004.slice/crio-2bcc016db0e364b2d3b6e095d434b8a9df0e63cfcfa261c988321704c2a13b9e WatchSource:0}: Error finding container 2bcc016db0e364b2d3b6e095d434b8a9df0e63cfcfa261c988321704c2a13b9e: Status 404 returned error can't find the container with id 2bcc016db0e364b2d3b6e095d434b8a9df0e63cfcfa261c988321704c2a13b9e
Sep 09 18:54:41.019721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.019680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-382217" event={"ID":"dd2e78bd-3c19-4065-b7e7-a7a992f29004","Type":"ContainerStarted","Data":"45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c"}
Sep 09 18:54:41.019721 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.019724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-382217" event={"ID":"dd2e78bd-3c19-4065-b7e7-a7a992f29004","Type":"ContainerStarted","Data":"2bcc016db0e364b2d3b6e095d434b8a9df0e63cfcfa261c988321704c2a13b9e"}
Sep 09 18:54:41.040038 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.039975    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7759-382217" podStartSLOduration=2.039956066 podStartE2EDuration="2.039956066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:41.037958862 +0000 UTC m=+1376.900896561" watchObservedRunningTime="2026-09-09 18:54:41.039956066 +0000 UTC m=+1376.902893764"
Sep 09 18:54:41.672049 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.672004    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7759-382217"]
Sep 09 18:54:41.676498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.676471    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7759-382217"]
Sep 09 18:54:41.799041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.798956    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7759-72165b"]
Sep 09 18:54:41.799495 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.799476    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" containerName="test-curl-7759-382217"
Sep 09 18:54:41.799610 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.799497    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" containerName="test-curl-7759-382217"
Sep 09 18:54:41.799671 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.799610    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" containerName="test-curl-7759-382217"
Sep 09 18:54:41.801527 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.801504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:41.807233 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.807203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-72165b"]
Sep 09 18:54:41.854009 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.853969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4rd\" (UniqueName: \"kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd\") pod \"test-curl-7759-72165b\" (UID: \"db06a79a-af94-4367-a22c-a81018dffb7b\") " pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:41.955028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.954988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4rd\" (UniqueName: \"kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd\") pod \"test-curl-7759-72165b\" (UID: \"db06a79a-af94-4367-a22c-a81018dffb7b\") " pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:41.962975 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:41.962945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4rd\" (UniqueName: \"kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd\") pod \"test-curl-7759-72165b\" (UID: \"db06a79a-af94-4367-a22c-a81018dffb7b\") " pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:42.027200 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:42.027165    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7759-382217" container="test-curl-7759-382217"
Sep 09 18:54:42.107291 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:42.107193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:54:42.112738 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:42.112714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:42.397210 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:42.397178    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-72165b"]
Sep 09 18:54:42.401648 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:42.401617    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb06a79a_af94_4367_a22c_a81018dffb7b.slice/crio-948e0dbce96fabd3ab73e1e85a56e0f16fa390db59ea23d8018c8960d109b227 WatchSource:0}: Error finding container 948e0dbce96fabd3ab73e1e85a56e0f16fa390db59ea23d8018c8960d109b227: Status 404 returned error can't find the container with id 948e0dbce96fabd3ab73e1e85a56e0f16fa390db59ea23d8018c8960d109b227
Sep 09 18:54:43.035318 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.035275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-72165b" event={"ID":"db06a79a-af94-4367-a22c-a81018dffb7b","Type":"ContainerStarted","Data":"ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b"}
Sep 09 18:54:43.035751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.035331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-72165b" event={"ID":"db06a79a-af94-4367-a22c-a81018dffb7b","Type":"ContainerStarted","Data":"948e0dbce96fabd3ab73e1e85a56e0f16fa390db59ea23d8018c8960d109b227"}
Sep 09 18:54:43.035751 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.035502    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7759-382217" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" containerName="test-curl-7759-382217" containerID="cri-o://45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c" gracePeriod=2
Sep 09 18:54:43.050153 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.050107    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7759-72165b" podStartSLOduration=2.050091671 podStartE2EDuration="2.050091671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:43.049497275 +0000 UTC m=+1378.912434975" watchObservedRunningTime="2026-09-09 18:54:43.050091671 +0000 UTC m=+1378.913029368"
Sep 09 18:54:43.688821 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.688720    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7759-72165b"]
Sep 09 18:54:43.691628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.691600    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7759-72165b"]
Sep 09 18:54:43.815719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.815680    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7759-f5e749"]
Sep 09 18:54:43.816132 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.816119    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" containerName="test-curl-7759-72165b"
Sep 09 18:54:43.816176 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.816133    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" containerName="test-curl-7759-72165b"
Sep 09 18:54:43.816217 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.816205    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" containerName="test-curl-7759-72165b"
Sep 09 18:54:43.818128 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.818112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:43.828183 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.828158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-f5e749"]
Sep 09 18:54:43.875253 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.875224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfhf\" (UniqueName: \"kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf\") pod \"test-curl-7759-f5e749\" (UID: \"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae\") " pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:43.976655 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.976569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfhf\" (UniqueName: \"kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf\") pod \"test-curl-7759-f5e749\" (UID: \"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae\") " pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:43.985446 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:43.985383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfhf\" (UniqueName: \"kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf\") pod \"test-curl-7759-f5e749\" (UID: \"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae\") " pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:44.042517 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:44.042486    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7759-72165b" container="test-curl-7759-72165b"
Sep 09 18:54:44.129024 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:44.128989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:44.404747 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:44.404710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-f5e749"]
Sep 09 18:54:44.405860 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:44.405832    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb682b2b5_86f3_4fc2_b4fa_c7e506dbd1ae.slice/crio-dadf0c1753a752b52d1c50e3befe5de0c3224eab0a07c804e92e7a251b413c55 WatchSource:0}: Error finding container dadf0c1753a752b52d1c50e3befe5de0c3224eab0a07c804e92e7a251b413c55: Status 404 returned error can't find the container with id dadf0c1753a752b52d1c50e3befe5de0c3224eab0a07c804e92e7a251b413c55
Sep 09 18:54:45.050930 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.050896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-f5e749" event={"ID":"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae","Type":"ContainerStarted","Data":"8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7"}
Sep 09 18:54:45.051307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.050945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-f5e749" event={"ID":"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae","Type":"ContainerStarted","Data":"dadf0c1753a752b52d1c50e3befe5de0c3224eab0a07c804e92e7a251b413c55"}
Sep 09 18:54:45.051307 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.051165    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7759-72165b" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" containerName="test-curl-7759-72165b" containerID="cri-o://ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b" gracePeriod=2
Sep 09 18:54:45.072794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.072736    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7759-f5e749" podStartSLOduration=2.072720891 podStartE2EDuration="2.072720891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:45.070417337 +0000 UTC m=+1380.933355038" watchObservedRunningTime="2026-09-09 18:54:45.072720891 +0000 UTC m=+1380.935658588"
Sep 09 18:54:45.203170 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.203144    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:45.289732 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.289650    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8r8c\" (UniqueName: \"kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c\") pod \"dd2e78bd-3c19-4065-b7e7-a7a992f29004\" (UID: \"dd2e78bd-3c19-4065-b7e7-a7a992f29004\") "
Sep 09 18:54:45.291585 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.291555    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c" (OuterVolumeSpecName: "kube-api-access-c8r8c") pod "dd2e78bd-3c19-4065-b7e7-a7a992f29004" (UID: "dd2e78bd-3c19-4065-b7e7-a7a992f29004"). InnerVolumeSpecName "kube-api-access-c8r8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:54:45.390806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.390766    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8r8c\" (UniqueName: \"kubernetes.io/projected/dd2e78bd-3c19-4065-b7e7-a7a992f29004-kube-api-access-c8r8c\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:54:45.687504 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.687471    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7759-f5e749"]
Sep 09 18:54:45.692531 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.692505    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7759-f5e749"]
Sep 09 18:54:45.810757 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.810722    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7759-4ab0bb"]
Sep 09 18:54:45.811207 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.811192    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" containerName="test-curl-7759-f5e749"
Sep 09 18:54:45.811247 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.811210    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" containerName="test-curl-7759-f5e749"
Sep 09 18:54:45.811296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.811281    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" containerName="test-curl-7759-f5e749"
Sep 09 18:54:45.814549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.814532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:45.818936 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.818908    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-4ab0bb"]
Sep 09 18:54:45.896113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.896072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbg9b\" (UniqueName: \"kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b\") pod \"test-curl-7759-4ab0bb\" (UID: \"ebae31fd-083b-49c4-a947-880bd7ad94e6\") " pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:45.997518 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:45.997378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbg9b\" (UniqueName: \"kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b\") pod \"test-curl-7759-4ab0bb\" (UID: \"ebae31fd-083b-49c4-a947-880bd7ad94e6\") " pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:46.008624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.008592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbg9b\" (UniqueName: \"kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b\") pod \"test-curl-7759-4ab0bb\" (UID: \"ebae31fd-083b-49c4-a947-880bd7ad94e6\") " pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:46.058068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.058034    2561 generic.go:356] "Generic (PLEG): container finished" podID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" containerID="45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c" exitCode=137
Sep 09 18:54:46.058536 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.058090    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:46.058536 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.058156    2561 scope.go:117] "RemoveContainer" containerID="45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c"
Sep 09 18:54:46.058536 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:46.058495    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7759-f5e749" container="test-curl-7759-f5e749"
Sep 09 18:54:46.067572 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.067557    2561 scope.go:117] "RemoveContainer" containerID="45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c"
Sep 09 18:54:46.067825 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:46.067804    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c\": container with ID starting with 45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c not found: ID does not exist" containerID="45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c"
Sep 09 18:54:46.067886 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.067833    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c"} err="failed to get container status \"45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c\": rpc error: code = NotFound desc = could not find container \"45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c\": container with ID starting with 45bf8a3d87564893f5a5a14b0ea4d1f3613ad1b5d2d98748358a198c0cf7fc8c not found: ID does not exist"
Sep 09 18:54:46.068985 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:46.068965    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7759-382217\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" pod="opendatahub/test-curl-7759-382217"
Sep 09 18:54:46.124775 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.124748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:46.397101 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.397074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7759-4ab0bb"]
Sep 09 18:54:46.398573 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:46.398545    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebae31fd_083b_49c4_a947_880bd7ad94e6.slice/crio-5362b2649a60f787aeed87e851fac2510b7f6609bb5d8e82ab57f4750301580b WatchSource:0}: Error finding container 5362b2649a60f787aeed87e851fac2510b7f6609bb5d8e82ab57f4750301580b: Status 404 returned error can't find the container with id 5362b2649a60f787aeed87e851fac2510b7f6609bb5d8e82ab57f4750301580b
Sep 09 18:54:46.609135 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:46.609101    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd2e78bd-3c19-4065-b7e7-a7a992f29004" path="/var/lib/kubelet/pods/dd2e78bd-3c19-4065-b7e7-a7a992f29004/volumes"
Sep 09 18:54:47.066188 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.066162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-4ab0bb" event={"ID":"ebae31fd-083b-49c4-a947-880bd7ad94e6","Type":"ContainerStarted","Data":"f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1"}
Sep 09 18:54:47.066541 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.066207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7759-4ab0bb" event={"ID":"ebae31fd-083b-49c4-a947-880bd7ad94e6","Type":"ContainerStarted","Data":"5362b2649a60f787aeed87e851fac2510b7f6609bb5d8e82ab57f4750301580b"}
Sep 09 18:54:47.067255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.067233    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7759-f5e749" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" containerName="test-curl-7759-f5e749" containerID="cri-o://8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7" gracePeriod=2
Sep 09 18:54:47.093065 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.093016    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7759-4ab0bb" podStartSLOduration=2.092998431 podStartE2EDuration="2.092998431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:47.092687763 +0000 UTC m=+1382.955625462" watchObservedRunningTime="2026-09-09 18:54:47.092998431 +0000 UTC m=+1382.955936130"
Sep 09 18:54:47.225296 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.225265    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:47.308956 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.308858    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw4rd\" (UniqueName: \"kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd\") pod \"db06a79a-af94-4367-a22c-a81018dffb7b\" (UID: \"db06a79a-af94-4367-a22c-a81018dffb7b\") "
Sep 09 18:54:47.311011 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.310986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd" (OuterVolumeSpecName: "kube-api-access-gw4rd") pod "db06a79a-af94-4367-a22c-a81018dffb7b" (UID: "db06a79a-af94-4367-a22c-a81018dffb7b"). InnerVolumeSpecName "kube-api-access-gw4rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:54:47.409873 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.409832    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw4rd\" (UniqueName: \"kubernetes.io/projected/db06a79a-af94-4367-a22c-a81018dffb7b-kube-api-access-gw4rd\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:54:47.750754 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.750716    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7759-4ab0bb"]
Sep 09 18:54:47.755200 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:47.755171    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7759-4ab0bb"]
Sep 09 18:54:48.074190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.074099    2561 generic.go:356] "Generic (PLEG): container finished" podID="db06a79a-af94-4367-a22c-a81018dffb7b" containerID="ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b" exitCode=137
Sep 09 18:54:48.074190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.074143    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:48.074190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.074153    2561 scope.go:117] "RemoveContainer" containerID="ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b"
Sep 09 18:54:48.074704 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:48.074497    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7759-4ab0bb" container="test-curl-7759-4ab0bb"
Sep 09 18:54:48.084001 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.083982    2561 scope.go:117] "RemoveContainer" containerID="ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b"
Sep 09 18:54:48.084251 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:48.084231    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b\": container with ID starting with ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b not found: ID does not exist" containerID="ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b"
Sep 09 18:54:48.084302 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.084258    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b"} err="failed to get container status \"ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b\": rpc error: code = NotFound desc = could not find container \"ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b\": container with ID starting with ff938e782172d97e671e3e3e066741d14b1f00304ba7416a70a8e5dca4cc6e4b not found: ID does not exist"
Sep 09 18:54:48.084930 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:48.084908    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7759-72165b\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" pod="opendatahub/test-curl-7759-72165b"
Sep 09 18:54:48.610334 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.610302    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db06a79a-af94-4367-a22c-a81018dffb7b" path="/var/lib/kubelet/pods/db06a79a-af94-4367-a22c-a81018dffb7b/volumes"
Sep 09 18:54:48.630830 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.630790    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:54:48.631258 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.631240    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" containerName="test-curl-7759-4ab0bb"
Sep 09 18:54:48.631345 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.631261    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" containerName="test-curl-7759-4ab0bb"
Sep 09 18:54:48.631429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.631417    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" containerName="test-curl-7759-4ab0bb"
Sep 09 18:54:48.635928 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.635904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.638564 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.638547    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-212790ce-openshift-default-dockercfg-sjdnb\""
Sep 09 18:54:48.652340 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.652319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:54:48.724208 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724424 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724424 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724574 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724574 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrwc\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.724780 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.724732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.825628 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.825587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826122 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826234 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrwc\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826234 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826420 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826566 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826566 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.826957 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.826927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.827472 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.827448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.827607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.827493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.828872 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.828851    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.829312 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.829257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.831035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.831007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.833378 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.833357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.836707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.836684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.837381 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.837357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrwc\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc\") pod \"e2e-mt-212790ce-openshift-default-56c56fdd56-cz875\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") " pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:48.949042 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:48.948998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:49.081330 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.081296    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7759-4ab0bb" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" containerName="test-curl-7759-4ab0bb" containerID="cri-o://f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1" gracePeriod=2
Sep 09 18:54:49.229111 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.229080    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:54:49.230564 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:54:49.230537    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1218aef_bc38_4f2c_b56b_6d4d14b7d765.slice/crio-711b11fec55c110eb30b4ab90a9d3328587dfac7dc52856890cffa857233923f WatchSource:0}: Error finding container 711b11fec55c110eb30b4ab90a9d3328587dfac7dc52856890cffa857233923f: Status 404 returned error can't find the container with id 711b11fec55c110eb30b4ab90a9d3328587dfac7dc52856890cffa857233923f
Sep 09 18:54:49.233189 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.233148    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:49.233262 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.233236    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:49.233297 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.233277    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:54:49.246208 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.246185    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:49.332277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.332246    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gfhf\" (UniqueName: \"kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf\") pod \"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae\" (UID: \"b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae\") "
Sep 09 18:54:49.334381 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.334353    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf" (OuterVolumeSpecName: "kube-api-access-5gfhf") pod "b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" (UID: "b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae"). InnerVolumeSpecName "kube-api-access-5gfhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:54:49.433604 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:49.433560    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gfhf\" (UniqueName: \"kubernetes.io/projected/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae-kube-api-access-5gfhf\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:54:50.089813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.089713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerStarted","Data":"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"}
Sep 09 18:54:50.089813 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.089783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerStarted","Data":"711b11fec55c110eb30b4ab90a9d3328587dfac7dc52856890cffa857233923f"}
Sep 09 18:54:50.091090 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.091065    2561 generic.go:356] "Generic (PLEG): container finished" podID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" containerID="8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7" exitCode=137
Sep 09 18:54:50.091224 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.091100    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:50.091224 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.091118    2561 scope.go:117] "RemoveContainer" containerID="8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7"
Sep 09 18:54:50.101239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.101215    2561 scope.go:117] "RemoveContainer" containerID="8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7"
Sep 09 18:54:50.101543 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:50.101525    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7\": container with ID starting with 8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7 not found: ID does not exist" containerID="8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7"
Sep 09 18:54:50.101607 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.101551    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7"} err="failed to get container status \"8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7\": rpc error: code = NotFound desc = could not find container \"8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7\": container with ID starting with 8c0eb9b22227b814867e59dcef387d4675f9aaf16ef6a1117c9bec821b1208a7 not found: ID does not exist"
Sep 09 18:54:50.110948 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.110909    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podStartSLOduration=2.110894204 podStartE2EDuration="2.110894204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:54:50.109602139 +0000 UTC m=+1385.972539857" watchObservedRunningTime="2026-09-09 18:54:50.110894204 +0000 UTC m=+1385.973831893"
Sep 09 18:54:50.111738 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:50.111715    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7759-f5e749\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" pod="opendatahub/test-curl-7759-f5e749"
Sep 09 18:54:50.609594 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.609560    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae" path="/var/lib/kubelet/pods/b682b2b5-86f3-4fc2-b4fa-c7e506dbd1ae/volumes"
Sep 09 18:54:50.949604 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.949559    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:50.954869 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:50.954841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:51.098521 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.098498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:51.099541 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.099516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:54:51.269948 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.269924    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:51.353591 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.353559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbg9b\" (UniqueName: \"kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b\") pod \"ebae31fd-083b-49c4-a947-880bd7ad94e6\" (UID: \"ebae31fd-083b-49c4-a947-880bd7ad94e6\") "
Sep 09 18:54:51.355728 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.355699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b" (OuterVolumeSpecName: "kube-api-access-qbg9b") pod "ebae31fd-083b-49c4-a947-880bd7ad94e6" (UID: "ebae31fd-083b-49c4-a947-880bd7ad94e6"). InnerVolumeSpecName "kube-api-access-qbg9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:54:51.454576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:51.454539    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbg9b\" (UniqueName: \"kubernetes.io/projected/ebae31fd-083b-49c4-a947-880bd7ad94e6-kube-api-access-qbg9b\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:54:52.105569 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.105529    2561 generic.go:356] "Generic (PLEG): container finished" podID="ebae31fd-083b-49c4-a947-880bd7ad94e6" containerID="f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1" exitCode=137
Sep 09 18:54:52.106070 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.105575    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:52.106070 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.105631    2561 scope.go:117] "RemoveContainer" containerID="f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1"
Sep 09 18:54:52.115645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.115626    2561 scope.go:117] "RemoveContainer" containerID="f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1"
Sep 09 18:54:52.116040 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:52.116011    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7759-4ab0bb\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" pod="opendatahub/test-curl-7759-4ab0bb"
Sep 09 18:54:52.116196 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:54:52.116066    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1\": container with ID starting with f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1 not found: ID does not exist" containerID="f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1"
Sep 09 18:54:52.116196 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.116117    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1"} err="failed to get container status \"f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1\": rpc error: code = NotFound desc = could not find container \"f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1\": container with ID starting with f7710bd78a75521c22915d8d53b3a7ea7107d2c882daa891d2a07336294fc2d1 not found: ID does not exist"
Sep 09 18:54:52.609543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:52.609512    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebae31fd-083b-49c4-a947-880bd7ad94e6" path="/var/lib/kubelet/pods/ebae31fd-083b-49c4-a947-880bd7ad94e6/volumes"
Sep 09 18:54:59.802330 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:54:59.802294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:55:10.227343 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.227307    2561 generic.go:356] "Generic (PLEG): container finished" podID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerID="28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9" exitCode=0
Sep 09 18:55:10.227793 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.227376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerDied","Data":"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"}
Sep 09 18:55:10.227843 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.227821    2561 scope.go:117] "RemoveContainer" containerID="28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"
Sep 09 18:55:10.229016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.228990    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:55:10.229073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.229062    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:55:10.229108 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:10.229094    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:55:11.235537 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:11.235494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerStarted","Data":"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"}
Sep 09 18:55:11.949561 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:11.949517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:55:11.949868 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:11.949832    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 09 18:55:11.950091 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:11.950061    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 09 18:55:12.950477 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:12.950435    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 09 18:55:12.951109 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:12.951072    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 09 18:55:13.949745 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:13.949703    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 09 18:55:13.949989 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:13.949788    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 09 18:55:14.950143 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:14.950105    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 09 18:55:14.950676 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:14.950181    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 09 18:55:15.949787 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:15.949740    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 09 18:55:15.950095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:15.950065    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 09 18:55:17.156438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:17.156380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:55:17.156938 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:17.156848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:55:17.157798 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:17.157771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:55:21.438599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:21.438562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:55:37.753221 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:37.753143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:55:44.772928 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:44.772894    2561 scope.go:117] "RemoveContainer" containerID="f7f35d1027a67ade020176995e51dbd7070a36bd14db1c72572326f2c8c30f75"
Sep 09 18:55:44.782323 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:44.782302    2561 scope.go:117] "RemoveContainer" containerID="9f311eba7c447073b6082fa0acf8668d2f088b68dd89eb5402af8b71819e615b"
Sep 09 18:55:51.280234 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.280199    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"]
Sep 09 18:55:51.285476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.285455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:51.287901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.287885    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:55:51.287966 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.287946    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:55:51.292568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.292542    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"]
Sep 09 18:55:51.357779 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.357740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-212790ce-ldjdf\" (UID: \"133837ed-1a4c-44ff-80e3-6ae550cfcc4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:51.458919 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.458873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-212790ce-ldjdf\" (UID: \"133837ed-1a4c-44ff-80e3-6ae550cfcc4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:51.460023 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.459947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-212790ce-ldjdf\" (UID: \"133837ed-1a4c-44ff-80e3-6ae550cfcc4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:51.598903 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.598816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:51.872590 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:51.872563    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"]
Sep 09 18:55:51.873923 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:55:51.873898    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133837ed_1a4c_44ff_80e3_6ae550cfcc4b.slice/crio-faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378 WatchSource:0}: Error finding container faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378: Status 404 returned error can't find the container with id faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378
Sep 09 18:55:52.517603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:52.517505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf" event={"ID":"133837ed-1a4c-44ff-80e3-6ae550cfcc4b","Type":"ContainerStarted","Data":"e83b3f226fa1f60335014cca82a690419f3fee9a9a0d82288b271fb1540d5468"}
Sep 09 18:55:52.517603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:52.517575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf" event={"ID":"133837ed-1a4c-44ff-80e3-6ae550cfcc4b","Type":"ContainerStarted","Data":"faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378"}
Sep 09 18:55:52.533438 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:52.533366    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf" podStartSLOduration=1.533351178 podStartE2EDuration="1.533351178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:55:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:55:52.531750806 +0000 UTC m=+1448.394688504" watchObservedRunningTime="2026-09-09 18:55:52.533351178 +0000 UTC m=+1448.396288879"
Sep 09 18:55:53.525461 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:53.525423    2561 generic.go:356] "Generic (PLEG): container finished" podID="133837ed-1a4c-44ff-80e3-6ae550cfcc4b" containerID="e83b3f226fa1f60335014cca82a690419f3fee9a9a0d82288b271fb1540d5468" exitCode=0
Sep 09 18:55:53.525848 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:53.525482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf" event={"ID":"133837ed-1a4c-44ff-80e3-6ae550cfcc4b","Type":"ContainerDied","Data":"e83b3f226fa1f60335014cca82a690419f3fee9a9a0d82288b271fb1540d5468"}
Sep 09 18:55:54.673601 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:54.673577    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:54.694220 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:54.694186    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca\") pod \"133837ed-1a4c-44ff-80e3-6ae550cfcc4b\" (UID: \"133837ed-1a4c-44ff-80e3-6ae550cfcc4b\") "
Sep 09 18:55:54.694593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:54.694573    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "133837ed-1a4c-44ff-80e3-6ae550cfcc4b" (UID: "133837ed-1a4c-44ff-80e3-6ae550cfcc4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:55:54.795269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:54.795184    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/133837ed-1a4c-44ff-80e3-6ae550cfcc4b-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:55:55.538765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:55.538725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"
Sep 09 18:55:55.538942 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:55.538756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf" event={"ID":"133837ed-1a4c-44ff-80e3-6ae550cfcc4b","Type":"ContainerDied","Data":"faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378"}
Sep 09 18:55:55.538942 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:55.538847    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa1780f719ad5d836b7971c96b4fb067f2543feaf0577b1fdaeb61d9a8d5378"
Sep 09 18:55:56.198562 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:55:56.198522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:56:07.198095 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.198055    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"]
Sep 09 18:56:07.202962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.202936    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-212790ce-ldjdf"]
Sep 09 18:56:07.602923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.602836    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7762-c264ec"]
Sep 09 18:56:07.603245 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.603232    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133837ed-1a4c-44ff-80e3-6ae550cfcc4b" containerName="revoke-keys"
Sep 09 18:56:07.603289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.603247    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="133837ed-1a4c-44ff-80e3-6ae550cfcc4b" containerName="revoke-keys"
Sep 09 18:56:07.603336 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.603327    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="133837ed-1a4c-44ff-80e3-6ae550cfcc4b" containerName="revoke-keys"
Sep 09 18:56:07.606603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.606587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:07.608905 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.608880    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s9dww\""
Sep 09 18:56:07.612645 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.612607    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-c264ec"]
Sep 09 18:56:07.735118 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.735076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzxz\" (UniqueName: \"kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz\") pod \"test-curl-7762-c264ec\" (UID: \"09ba78b3-599d-4382-bb0a-5ebde611a2fd\") " pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:07.835992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.835957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzxz\" (UniqueName: \"kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz\") pod \"test-curl-7762-c264ec\" (UID: \"09ba78b3-599d-4382-bb0a-5ebde611a2fd\") " pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:07.843548 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.843506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzxz\" (UniqueName: \"kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz\") pod \"test-curl-7762-c264ec\" (UID: \"09ba78b3-599d-4382-bb0a-5ebde611a2fd\") " pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:07.918068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:07.918040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:08.191638 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:08.191605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-c264ec"]
Sep 09 18:56:08.192752 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:56:08.192723    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09ba78b3_599d_4382_bb0a_5ebde611a2fd.slice/crio-56203bb76ba17acb6e316e107b0b3bfaac8a131cd431494c61ee19ccf89529cf WatchSource:0}: Error finding container 56203bb76ba17acb6e316e107b0b3bfaac8a131cd431494c61ee19ccf89529cf: Status 404 returned error can't find the container with id 56203bb76ba17acb6e316e107b0b3bfaac8a131cd431494c61ee19ccf89529cf
Sep 09 18:56:08.610342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:08.610258    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133837ed-1a4c-44ff-80e3-6ae550cfcc4b" path="/var/lib/kubelet/pods/133837ed-1a4c-44ff-80e3-6ae550cfcc4b/volumes"
Sep 09 18:56:08.627675 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:08.627645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-c264ec" event={"ID":"09ba78b3-599d-4382-bb0a-5ebde611a2fd","Type":"ContainerStarted","Data":"75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3"}
Sep 09 18:56:08.627838 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:08.627683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-c264ec" event={"ID":"09ba78b3-599d-4382-bb0a-5ebde611a2fd","Type":"ContainerStarted","Data":"56203bb76ba17acb6e316e107b0b3bfaac8a131cd431494c61ee19ccf89529cf"}
Sep 09 18:56:08.643851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:08.643800    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7762-c264ec" podStartSLOduration=1.6437868500000001 podStartE2EDuration="1.64378685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:56:08.641840893 +0000 UTC m=+1464.504778592" watchObservedRunningTime="2026-09-09 18:56:08.64378685 +0000 UTC m=+1464.506724548"
Sep 09 18:56:09.231347 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:09.231301    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7762-c264ec"]
Sep 09 18:56:09.234701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:09.234673    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7762-c264ec"]
Sep 09 18:56:09.633895 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:56:09.633863    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7762-c264ec" container="test-curl-7762-c264ec"
Sep 09 18:56:10.639277 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:10.639225    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7762-c264ec" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" containerName="test-curl-7762-c264ec" containerID="cri-o://75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3" gracePeriod=2
Sep 09 18:56:12.790951 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:12.790922    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:12.889073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:12.889032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmzxz\" (UniqueName: \"kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz\") pod \"09ba78b3-599d-4382-bb0a-5ebde611a2fd\" (UID: \"09ba78b3-599d-4382-bb0a-5ebde611a2fd\") "
Sep 09 18:56:12.891122 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:12.891086    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz" (OuterVolumeSpecName: "kube-api-access-tmzxz") pod "09ba78b3-599d-4382-bb0a-5ebde611a2fd" (UID: "09ba78b3-599d-4382-bb0a-5ebde611a2fd"). InnerVolumeSpecName "kube-api-access-tmzxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:56:12.989789 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:12.989749    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmzxz\" (UniqueName: \"kubernetes.io/projected/09ba78b3-599d-4382-bb0a-5ebde611a2fd-kube-api-access-tmzxz\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:56:13.662938 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:13.662898    2561 generic.go:356] "Generic (PLEG): container finished" podID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" containerID="75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3" exitCode=137
Sep 09 18:56:13.663141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:13.662940    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:13.663141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:13.662960    2561 scope.go:117] "RemoveContainer" containerID="75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3"
Sep 09 18:56:13.672554 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:13.672535    2561 scope.go:117] "RemoveContainer" containerID="75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3"
Sep 09 18:56:13.672826 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:56:13.672810    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3\": container with ID starting with 75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3 not found: ID does not exist" containerID="75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3"
Sep 09 18:56:13.672877 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:13.672836    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3"} err="failed to get container status \"75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3\": rpc error: code = NotFound desc = could not find container \"75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3\": container with ID starting with 75347274a88006245fa0036a172a1d84d732eac2b64caa3ce1491c6a92881ac3 not found: ID does not exist"
Sep 09 18:56:13.673213 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:56:13.673196    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-c264ec\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:14.607267 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:56:14.607225    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-c264ec\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" pod="opendatahub/test-curl-7762-c264ec"
Sep 09 18:56:14.609006 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:14.608982    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" path="/var/lib/kubelet/pods/09ba78b3-599d-4382-bb0a-5ebde611a2fd/volumes"
Sep 09 18:56:15.554686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:15.554649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:56:35.410487 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:35.410452    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:56:44.689529 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:44.689501    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:56:44.695028 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:44.695005    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 18:56:44.827979 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:44.827951    2561 scope.go:117] "RemoveContainer" containerID="3f19b42ededbb5908491bacbefdd08cf99b06d808c4626cd63245f33d0cd2bc6"
Sep 09 18:56:44.837377 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:44.837355    2561 scope.go:117] "RemoveContainer" containerID="bc5c8401979f7c79aa6fc685771e4b627a7d20c1d4a89a29e124a89298e866dd"
Sep 09 18:56:58.593568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:58.593533    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:56:58.593974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:56:58.593786    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" containerID="cri-o://4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6" gracePeriod=30
Sep 09 18:57:02.159901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:02.159852    2561 patch_prober.go:28] interesting pod/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 18:57:02.160309 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:02.159928    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 18:57:03.851742 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.851672    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:57:03.894616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894616 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894620    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894695    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894720    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894747    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894783    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.894845 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894827    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmrwc\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.895114 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.895114 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.894896    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs\") pod \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\" (UID: \"e1218aef-bc38-4f2c-b56b-6d4d14b7d765\") "
Sep 09 18:57:03.895114 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895021    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:57:03.895278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895122    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:57:03.895278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895229    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:57:03.895278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895249    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.895278 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895266    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.895510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895437    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:57:03.895510 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.895454    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:57:03.897346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.897319    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:57:03.897480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.897341    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:57:03.897480 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.897431    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:57:03.897600 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.897552    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc" (OuterVolumeSpecName: "kube-api-access-fmrwc") pod "e1218aef-bc38-4f2c-b56b-6d4d14b7d765" (UID: "e1218aef-bc38-4f2c-b56b-6d4d14b7d765"). InnerVolumeSpecName "kube-api-access-fmrwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:57:03.989761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.989727    2561 generic.go:356] "Generic (PLEG): container finished" podID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerID="4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6" exitCode=0
Sep 09 18:57:03.989761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.989766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerDied","Data":"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"}
Sep 09 18:57:03.989973 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.989780    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"
Sep 09 18:57:03.989973 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.989819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875" event={"ID":"e1218aef-bc38-4f2c-b56b-6d4d14b7d765","Type":"ContainerDied","Data":"711b11fec55c110eb30b4ab90a9d3328587dfac7dc52856890cffa857233923f"}
Sep 09 18:57:03.989973 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.989840    2561 scope.go:117] "RemoveContainer" containerID="4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"
Sep 09 18:57:03.995974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.995951    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.995974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.995973    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.996116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.995983    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.996116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.995992    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmrwc\" (UniqueName: \"kubernetes.io/projected/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-kube-api-access-fmrwc\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.996116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.996001    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.996116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.996009    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:03.996116 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:03.996018    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1218aef-bc38-4f2c-b56b-6d4d14b7d765-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:57:04.000270 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.000253    2561 scope.go:117] "RemoveContainer" containerID="28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"
Sep 09 18:57:04.008595 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.008577    2561 scope.go:117] "RemoveContainer" containerID="4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"
Sep 09 18:57:04.008861 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:57:04.008842    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6\": container with ID starting with 4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6 not found: ID does not exist" containerID="4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"
Sep 09 18:57:04.008923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.008868    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6"} err="failed to get container status \"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6\": rpc error: code = NotFound desc = could not find container \"4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6\": container with ID starting with 4e4f0f6b92d5cece9c1b05763f938ff1a98afbe8c6a6458192220398908d9ed6 not found: ID does not exist"
Sep 09 18:57:04.008923 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.008883    2561 scope.go:117] "RemoveContainer" containerID="28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"
Sep 09 18:57:04.009117 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:57:04.009100    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9\": container with ID starting with 28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9 not found: ID does not exist" containerID="28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"
Sep 09 18:57:04.009161 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.009120    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9"} err="failed to get container status \"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9\": rpc error: code = NotFound desc = could not find container \"28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9\": container with ID starting with 28580f6e5aab8d87df439af05fe4796295291b5272fb32fd0446427e8f3374a9 not found: ID does not exist"
Sep 09 18:57:04.014082 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.014061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:57:04.018055 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.018032    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-212790ce-openshift-default-56c56fdd56-cz875"]
Sep 09 18:57:04.615235 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.615199    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" path="/var/lib/kubelet/pods/e1218aef-bc38-4f2c-b56b-6d4d14b7d765/volumes"
Sep 09 18:57:04.702511 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:04.702474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:57:18.200498 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:18.200408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:57:35.705082 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:35.705038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:57:44.872593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:44.872559    2561 scope.go:117] "RemoveContainer" containerID="7cc6ede54b421e00ba4b75817df739c1564a3374f6b0b1f8dfb2d9577526d053"
Sep 09 18:57:44.881576 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:44.881554    2561 scope.go:117] "RemoveContainer" containerID="459c64793c1a5efb001b2e8e3851765214aab0a5d62e89e066135dd513096ed8"
Sep 09 18:57:50.599623 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:50.599588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:57:53.213150 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213117    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:57:53.213543 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213535    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.213592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213548    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.213592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213556    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" containerName="test-curl-7762-c264ec"
Sep 09 18:57:53.213592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213562    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" containerName="test-curl-7762-c264ec"
Sep 09 18:57:53.213592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213572    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.213592 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213578    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.213763 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213652    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ba78b3-599d-4382-bb0a-5ebde611a2fd" containerName="test-curl-7762-c264ec"
Sep 09 18:57:53.213763 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213659    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.213763 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.213666    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1218aef-bc38-4f2c-b56b-6d4d14b7d765" containerName="istio-proxy"
Sep 09 18:57:53.216807 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.216791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.219079 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.219059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-79b1ac-openshift-default-dockercfg-xng6v\""
Sep 09 18:57:53.230151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.230128    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:57:53.283075 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283038    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxfw\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283423 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283423 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283423 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.283542 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.283462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384547 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxfw\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384755 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.384983 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.384911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.385153 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.385013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.385357 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.385326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.387052 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.387030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.387186 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.387171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.391995 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.391973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.392460 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.392428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxfw\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw\") pod \"e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") " pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.527911 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.527802    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:53.805950 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.805920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:57:53.807728 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:57:53.807700    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb72399_1720_4306_b26f_af043a63bc1c.slice/crio-4c3027a3a557cde3167f9921a94ddf082c92100ad56283debdc2754404ad3fa0 WatchSource:0}: Error finding container 4c3027a3a557cde3167f9921a94ddf082c92100ad56283debdc2754404ad3fa0: Status 404 returned error can't find the container with id 4c3027a3a557cde3167f9921a94ddf082c92100ad56283debdc2754404ad3fa0
Sep 09 18:57:53.809846 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.809811    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:57:53.809931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.809879    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:57:53.809931 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:53.809924    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:57:54.314322 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:54.314290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerStarted","Data":"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"}
Sep 09 18:57:54.314743 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:54.314339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerStarted","Data":"4c3027a3a557cde3167f9921a94ddf082c92100ad56283debdc2754404ad3fa0"}
Sep 09 18:57:54.336687 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:54.336637    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podStartSLOduration=1.336620358 podStartE2EDuration="1.336620358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:57:54.333726623 +0000 UTC m=+1570.196664321" watchObservedRunningTime="2026-09-09 18:57:54.336620358 +0000 UTC m=+1570.199558056"
Sep 09 18:57:54.528268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:54.528229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:54.533696 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:54.533667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:55.320079 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:55.320048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:57:55.320972 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:57:55.320954    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:58:08.108269 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:08.108234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:58:10.775695 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:10.775655    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7762-a33d53"]
Sep 09 18:58:10.779775 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:10.779749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:10.782360 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:10.782337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-s9dww\""
Sep 09 18:58:10.786256 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:10.786232    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-a33d53"]
Sep 09 18:58:10.956719 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:10.956671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b54h\" (UniqueName: \"kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h\") pod \"test-curl-7762-a33d53\" (UID: \"0e125211-a426-4234-90d9-3f2f77a1cada\") " pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:11.058733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:11.058623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b54h\" (UniqueName: \"kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h\") pod \"test-curl-7762-a33d53\" (UID: \"0e125211-a426-4234-90d9-3f2f77a1cada\") " pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:11.068948 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:11.068909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b54h\" (UniqueName: \"kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h\") pod \"test-curl-7762-a33d53\" (UID: \"0e125211-a426-4234-90d9-3f2f77a1cada\") " pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:11.090958 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:11.090925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:11.380350 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:11.380319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-a33d53"]
Sep 09 18:58:11.381916 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:58:11.381888    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e125211_a426_4234_90d9_3f2f77a1cada.slice/crio-d3f29a82d6bd7d742853f760fde781eb898694e77686188ea7698228bfe21997 WatchSource:0}: Error finding container d3f29a82d6bd7d742853f760fde781eb898694e77686188ea7698228bfe21997: Status 404 returned error can't find the container with id d3f29a82d6bd7d742853f760fde781eb898694e77686188ea7698228bfe21997
Sep 09 18:58:11.424016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:11.423988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-a33d53" event={"ID":"0e125211-a426-4234-90d9-3f2f77a1cada","Type":"ContainerStarted","Data":"d3f29a82d6bd7d742853f760fde781eb898694e77686188ea7698228bfe21997"}
Sep 09 18:58:12.432209 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:12.432169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-a33d53" event={"ID":"0e125211-a426-4234-90d9-3f2f77a1cada","Type":"ContainerStarted","Data":"ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553"}
Sep 09 18:58:12.446352 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:12.446286    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7762-a33d53" podStartSLOduration=2.446264748 podStartE2EDuration="2.446264748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:58:12.444122687 +0000 UTC m=+1588.307060412" watchObservedRunningTime="2026-09-09 18:58:12.446264748 +0000 UTC m=+1588.309202447"
Sep 09 18:58:13.127773 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.127686    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7762-a33d53"]
Sep 09 18:58:13.132469 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.132442    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7762-a33d53"]
Sep 09 18:58:13.265360 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.265318    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7762-5230f7"]
Sep 09 18:58:13.266009 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.265986    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" containerName="test-curl-7762-a33d53"
Sep 09 18:58:13.266147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.266012    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" containerName="test-curl-7762-a33d53"
Sep 09 18:58:13.266147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.266133    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" containerName="test-curl-7762-a33d53"
Sep 09 18:58:13.272444 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.272418    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:13.273798 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.273761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-5230f7"]
Sep 09 18:58:13.389085 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.388989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4cj\" (UniqueName: \"kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj\") pod \"test-curl-7762-5230f7\" (UID: \"f17b9c60-90e9-4128-ab06-50e0b7a3f711\") " pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:13.438321 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:13.438289    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7762-a33d53" container="test-curl-7762-a33d53"
Sep 09 18:58:13.490663 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.490618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4cj\" (UniqueName: \"kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj\") pod \"test-curl-7762-5230f7\" (UID: \"f17b9c60-90e9-4128-ab06-50e0b7a3f711\") " pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:13.499167 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.499143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4cj\" (UniqueName: \"kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj\") pod \"test-curl-7762-5230f7\" (UID: \"f17b9c60-90e9-4128-ab06-50e0b7a3f711\") " pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:13.584612 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.584566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:13.869756 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:13.869715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7762-5230f7"]
Sep 09 18:58:13.876917 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:58:13.876878    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf17b9c60_90e9_4128_ab06_50e0b7a3f711.slice/crio-342c449cace0d5a13b7f66899834b444f180b0f15324e5bf3de55258b6beb6f9 WatchSource:0}: Error finding container 342c449cace0d5a13b7f66899834b444f180b0f15324e5bf3de55258b6beb6f9: Status 404 returned error can't find the container with id 342c449cace0d5a13b7f66899834b444f180b0f15324e5bf3de55258b6beb6f9
Sep 09 18:58:14.448593 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:14.448547    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7762-a33d53" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" containerName="test-curl-7762-a33d53" containerID="cri-o://ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553" gracePeriod=2
Sep 09 18:58:14.449478 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:14.449449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-5230f7" event={"ID":"f17b9c60-90e9-4128-ab06-50e0b7a3f711","Type":"ContainerStarted","Data":"258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992"}
Sep 09 18:58:14.449624 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:14.449494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7762-5230f7" event={"ID":"f17b9c60-90e9-4128-ab06-50e0b7a3f711","Type":"ContainerStarted","Data":"342c449cace0d5a13b7f66899834b444f180b0f15324e5bf3de55258b6beb6f9"}
Sep 09 18:58:14.451350 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:14.451307    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-a33d53\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:14.466642 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:14.466584    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7762-5230f7" podStartSLOduration=1.466565624 podStartE2EDuration="1.466565624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:58:14.464258065 +0000 UTC m=+1590.327195768" watchObservedRunningTime="2026-09-09 18:58:14.466565624 +0000 UTC m=+1590.329503323"
Sep 09 18:58:14.469256 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:14.469216    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-a33d53\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:14.607468 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:14.607431    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-a33d53\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:15.107914 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:15.107863    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7762-5230f7"]
Sep 09 18:58:15.112603 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:15.112574    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7762-5230f7"]
Sep 09 18:58:15.455353 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:15.455322    2561 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7762-5230f7" container="test-curl-7762-5230f7"
Sep 09 18:58:16.462648 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:16.462593    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7762-5230f7" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" containerName="test-curl-7762-5230f7" containerID="cri-o://258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992" gracePeriod=2
Sep 09 18:58:16.464678 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:16.464644    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-5230f7\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:16.626238 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:16.626210    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:16.722570 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:16.722488    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b54h\" (UniqueName: \"kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h\") pod \"0e125211-a426-4234-90d9-3f2f77a1cada\" (UID: \"0e125211-a426-4234-90d9-3f2f77a1cada\") "
Sep 09 18:58:16.724550 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:16.724514    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h" (OuterVolumeSpecName: "kube-api-access-9b54h") pod "0e125211-a426-4234-90d9-3f2f77a1cada" (UID: "0e125211-a426-4234-90d9-3f2f77a1cada"). InnerVolumeSpecName "kube-api-access-9b54h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:58:16.824094 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:16.824053    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b54h\" (UniqueName: \"kubernetes.io/projected/0e125211-a426-4234-90d9-3f2f77a1cada-kube-api-access-9b54h\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:58:17.470471 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:17.470436    2561 generic.go:356] "Generic (PLEG): container finished" podID="0e125211-a426-4234-90d9-3f2f77a1cada" containerID="ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553" exitCode=137
Sep 09 18:58:17.470926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:17.470494    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:17.470926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:17.470495    2561 scope.go:117] "RemoveContainer" containerID="ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553"
Sep 09 18:58:17.480449 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:17.480427    2561 scope.go:117] "RemoveContainer" containerID="ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553"
Sep 09 18:58:17.480733 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:17.480711    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553\": container with ID starting with ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553 not found: ID does not exist" containerID="ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553"
Sep 09 18:58:17.480818 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:17.480741    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553"} err="failed to get container status \"ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553\": rpc error: code = NotFound desc = could not find container \"ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553\": container with ID starting with ad3702a4b637b7ee08da2f5adb030a6b2cb027c3a07d09fb65755db870f55553 not found: ID does not exist"
Sep 09 18:58:17.481212 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:17.481183    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-a33d53\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:18.479486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.479458    2561 generic.go:356] "Generic (PLEG): container finished" podID="2eb72399-1720-4306-b26f-af043a63bc1c" containerID="2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79" exitCode=0
Sep 09 18:58:18.479806 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.479526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerDied","Data":"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"}
Sep 09 18:58:18.479933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.479920    2561 scope.go:117] "RemoveContainer" containerID="2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"
Sep 09 18:58:18.481048 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.481020    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:18.481137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.481086    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:18.481137 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.481117    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:18.506545 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:18.506509    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-a33d53\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" pod="opendatahub/test-curl-7762-a33d53"
Sep 09 18:58:18.610486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.610453    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e125211-a426-4234-90d9-3f2f77a1cada" path="/var/lib/kubelet/pods/0e125211-a426-4234-90d9-3f2f77a1cada/volumes"
Sep 09 18:58:18.677522 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.677496    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:18.743830 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.743732    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr4cj\" (UniqueName: \"kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj\") pod \"f17b9c60-90e9-4128-ab06-50e0b7a3f711\" (UID: \"f17b9c60-90e9-4128-ab06-50e0b7a3f711\") "
Sep 09 18:58:18.746284 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.746256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj" (OuterVolumeSpecName: "kube-api-access-kr4cj") pod "f17b9c60-90e9-4128-ab06-50e0b7a3f711" (UID: "f17b9c60-90e9-4128-ab06-50e0b7a3f711"). InnerVolumeSpecName "kube-api-access-kr4cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:58:18.844712 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:18.844674    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr4cj\" (UniqueName: \"kubernetes.io/projected/f17b9c60-90e9-4128-ab06-50e0b7a3f711-kube-api-access-kr4cj\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:58:19.487136 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.487098    2561 generic.go:356] "Generic (PLEG): container finished" podID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" containerID="258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992" exitCode=137
Sep 09 18:58:19.487635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.487146    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:19.487635 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.487159    2561 scope.go:117] "RemoveContainer" containerID="258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992"
Sep 09 18:58:19.489599 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.489578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerStarted","Data":"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"}
Sep 09 18:58:19.496949 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.496931    2561 scope.go:117] "RemoveContainer" containerID="258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992"
Sep 09 18:58:19.497187 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:19.497172    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992\": container with ID starting with 258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992 not found: ID does not exist" containerID="258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992"
Sep 09 18:58:19.497244 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.497193    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992"} err="failed to get container status \"258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992\": rpc error: code = NotFound desc = could not find container \"258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992\": container with ID starting with 258e3aa0c56a7d6c96c0a55a8e9290999abe01b2b17acd1199cb5edb519d2992 not found: ID does not exist"
Sep 09 18:58:19.515456 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:19.510848    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7762-5230f7\" is forbidden: User \"system:node:ip-10-0-135-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-73.ec2.internal' and this object" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" pod="opendatahub/test-curl-7762-5230f7"
Sep 09 18:58:19.528782 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.528752    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:58:19.529016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.528996    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:19.529073 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:19.529054    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:20.529163 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:20.529124    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:20.529594 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:20.529197    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:20.608918 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:20.608882    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" path="/var/lib/kubelet/pods/f17b9c60-90e9-4128-ab06-50e0b7a3f711/volumes"
Sep 09 18:58:21.528538 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.528500    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:21.528807 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.528584    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:21.935147 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.935108    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:58:21.935608 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.935591    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" containerName="test-curl-7762-5230f7"
Sep 09 18:58:21.935653 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.935609    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" containerName="test-curl-7762-5230f7"
Sep 09 18:58:21.935701 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.935692    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f17b9c60-90e9-4128-ab06-50e0b7a3f711" containerName="test-curl-7762-5230f7"
Sep 09 18:58:21.945683 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.945650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.949814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.949780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8fbc9c-openshift-default-dockercfg-qk8t2\""
Sep 09 18:58:21.966974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.966946    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:58:21.980289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47sx9\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980486 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980707 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:21.980776 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:21.980747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.081999 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.081952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.082280 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.082257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47sx9\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.082445 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.082427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.082582 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.082566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.082704 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.082690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.082907 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.082892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.083017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.083002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.083151 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.083134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.083283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.083268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.084148 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.084123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.084769 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.084696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.084922 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.084899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.086252 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.085704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.086415 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.086174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.088159 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.088124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.090239 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.090219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.092814 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.092791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.097250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.097231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47sx9\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9\") pod \"e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") " pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.273973 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.273882    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:22.528771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.528683    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:22.528771 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.528741    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:22.570540 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.570510    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:58:22.571114 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:58:22.571092    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dfdfd7_dd40_468c_ac42_7f92e8b10d4f.slice/crio-b586ac81f6b2732f47220f68513c0923984e1fd1be2891a2cd1449bbd53c84f4 WatchSource:0}: Error finding container b586ac81f6b2732f47220f68513c0923984e1fd1be2891a2cd1449bbd53c84f4: Status 404 returned error can't find the container with id b586ac81f6b2732f47220f68513c0923984e1fd1be2891a2cd1449bbd53c84f4
Sep 09 18:58:22.573921 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.573876    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:22.574003 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.573958    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:22.574003 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:22.573985    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:23.517794 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:23.517745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerStarted","Data":"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"}
Sep 09 18:58:23.518198 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:23.517816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerStarted","Data":"b586ac81f6b2732f47220f68513c0923984e1fd1be2891a2cd1449bbd53c84f4"}
Sep 09 18:58:23.529016 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:23.528982    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:23.529157 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:23.529035    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:23.543308 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:23.543236    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podStartSLOduration=2.543213985 podStartE2EDuration="2.543213985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:58:23.53760087 +0000 UTC m=+1599.400538580" watchObservedRunningTime="2026-09-09 18:58:23.543213985 +0000 UTC m=+1599.406151685"
Sep 09 18:58:24.274748 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.274702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:24.279556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.279531    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:24.525061 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.524981    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:24.525982 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.525957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:24.528266 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.528243    2561 patch_prober.go:28] interesting pod/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 09 18:58:24.528353 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:24.528286    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 09 18:58:25.320826 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:25.320792    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:58:25.533106 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:25.533079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:58:25.534004 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:25.533984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:58:26.666069 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.666038    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:58:26.670709 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.670687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.673384 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.673360    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:58:26.673549 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.673414    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 18:58:26.673638 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.673622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-8fbc9c-serving-cert\""
Sep 09 18:58:26.674158 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.674136    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wsrn9\""
Sep 09 18:58:26.674323 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.674302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 18:58:26.700568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.700527    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:58:26.733187 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.733160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.733346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.733263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.733346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.733308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lph4c\" (UniqueName: \"kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.733346 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.733333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.834526 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.834485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.834708 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.834536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lph4c\" (UniqueName: \"kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.834708 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.834567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.834708 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.834625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.834821 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:26.834719    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-serving-cert: secret "maas-api-e2e-api-b-8fbc9c-serving-cert" not found
Sep 09 18:58:26.834821 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:58:26.834794    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls podName:c4b179e3-4beb-42f0-9abd-bfbdb216701c nodeName:}" failed. No retries permitted until 2026-09-09 18:58:27.334777512 +0000 UTC m=+1603.197715200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls") pod "maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" (UID: "c4b179e3-4beb-42f0-9abd-bfbdb216701c") : secret "maas-api-e2e-api-b-8fbc9c-serving-cert" not found
Sep 09 18:58:26.835271 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.835243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.837090 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.837071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:26.850909 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:26.850883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lph4c\" (UniqueName: \"kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:27.173113 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.173076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:58:27.340200 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.340165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:27.342807 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.342771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") pod \"maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:27.583992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.583908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:27.861040 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.860997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:58:27.862299 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:58:27.862267    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b179e3_4beb_42f0_9abd_bfbdb216701c.slice/crio-c3db51b1997fc23a35f53c173650ed78007b58fbf08d210dfb5730371a363324 WatchSource:0}: Error finding container c3db51b1997fc23a35f53c173650ed78007b58fbf08d210dfb5730371a363324: Status 404 returned error can't find the container with id c3db51b1997fc23a35f53c173650ed78007b58fbf08d210dfb5730371a363324
Sep 09 18:58:27.864131 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:27.864104    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 18:58:28.555686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:28.555643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" event={"ID":"c4b179e3-4beb-42f0-9abd-bfbdb216701c","Type":"ContainerStarted","Data":"c3db51b1997fc23a35f53c173650ed78007b58fbf08d210dfb5730371a363324"}
Sep 09 18:58:31.575841 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:31.575798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" event={"ID":"c4b179e3-4beb-42f0-9abd-bfbdb216701c","Type":"ContainerStarted","Data":"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"}
Sep 09 18:58:31.576280 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:31.575893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:31.592711 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:31.592659    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" podStartSLOduration=2.949653798 podStartE2EDuration="5.592640154s" totalImagesPullingTime="2.642986356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:58:31.591886578 +0000 UTC m=+1607.454824295" watchObservedRunningTime="2026-09-09 18:58:31.592640154 +0000 UTC m=+1607.455577853"
Sep 09 18:58:37.587517 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:37.587436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:58:43.602331 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:43.602288    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:58:44.915767 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:44.915734    2561 scope.go:117] "RemoveContainer" containerID="281842b22799a5bea3c17afbf39478c1ef0a65e975a07d5d2fbc8de1133ee671"
Sep 09 18:58:44.924900 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:44.924880    2561 scope.go:117] "RemoveContainer" containerID="acc20872d4428f6bdade0b8a95983d441fd1e6396cb76e15d1e67f60f8faa880"
Sep 09 18:58:45.707927 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.707840    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerID="d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd" exitCode=0
Sep 09 18:58:45.707927 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.707879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerDied","Data":"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"}
Sep 09 18:58:45.708342 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.708328    2561 scope.go:117] "RemoveContainer" containerID="d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"
Sep 09 18:58:45.709535 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.709504    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:45.709662 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.709591    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:45.709662 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:45.709638    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 18:58:46.715490 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:46.715448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerStarted","Data":"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"}
Sep 09 18:58:47.274444 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:47.274373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:47.274641 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:47.274628    2561 patch_prober.go:28] interesting pod/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 09 18:58:47.274686 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:47.274670    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 09 18:58:48.274974 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:48.274933    2561 patch_prober.go:28] interesting pod/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 09 18:58:48.275421 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:48.274990    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 09 18:58:49.274955 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:49.274919    2561 patch_prober.go:28] interesting pod/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 09 18:58:49.275162 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:49.274985    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 09 18:58:50.274577 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:50.274537    2561 patch_prober.go:28] interesting pod/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 09 18:58:50.274765 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:50.274592    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 09 18:58:51.274640 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:51.274602    2561 patch_prober.go:28] interesting pod/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Sep 09 18:58:51.275068 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:51.274662    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Sep 09 18:58:52.279213 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:52.279179    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:52.279812 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:52.279429    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:58:52.280208 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:58:52.280191    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:59:08.500852 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:08.500814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:59:15.556561 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:15.556518    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:59:15.557041 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:15.556778    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy" containerID="cri-o://e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23" gracePeriod=30
Sep 09 18:59:20.810255 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.810230    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:59:20.914568 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914539    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914733 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914725    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggxfw\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914861 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914861 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.914861 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914843    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:20.915014 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.915014 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.915112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.914900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:20.915112 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915030    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs\") pod \"2eb72399-1720-4306-b26f-af043a63bc1c\" (UID: \"2eb72399-1720-4306-b26f-af043a63bc1c\") "
Sep 09 18:59:20.915215 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:59:20.915274 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915210    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:20.915385 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915362    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:20.915555 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915535    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:20.915636 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915560    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:20.915636 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915574    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb72399-1720-4306-b26f-af043a63bc1c-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:20.915636 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915586    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:20.915636 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.915597    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:20.917017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.916993    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw" (OuterVolumeSpecName: "kube-api-access-ggxfw") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "kube-api-access-ggxfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:59:20.917017 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.917007    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:59:20.917195 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.917160    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:20.917281 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.917264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2eb72399-1720-4306-b26f-af043a63bc1c" (UID: "2eb72399-1720-4306-b26f-af043a63bc1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:59:20.927807 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.927779    2561 generic.go:356] "Generic (PLEG): container finished" podID="2eb72399-1720-4306-b26f-af043a63bc1c" containerID="e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23" exitCode=0
Sep 09 18:59:20.927926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.927834    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"
Sep 09 18:59:20.927926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.927846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerDied","Data":"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"}
Sep 09 18:59:20.927926 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.927901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57" event={"ID":"2eb72399-1720-4306-b26f-af043a63bc1c","Type":"ContainerDied","Data":"4c3027a3a557cde3167f9921a94ddf082c92100ad56283debdc2754404ad3fa0"}
Sep 09 18:59:20.928080 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.927935    2561 scope.go:117] "RemoveContainer" containerID="e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"
Sep 09 18:59:20.938947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.938929    2561 scope.go:117] "RemoveContainer" containerID="2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"
Sep 09 18:59:20.948287 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.948265    2561 scope.go:117] "RemoveContainer" containerID="e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"
Sep 09 18:59:20.948622 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:59:20.948603    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23\": container with ID starting with e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23 not found: ID does not exist" containerID="e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"
Sep 09 18:59:20.948706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.948632    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23"} err="failed to get container status \"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23\": rpc error: code = NotFound desc = could not find container \"e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23\": container with ID starting with e0818b970392d62bb50d820bd27b40a8a6b373ff16793b1a8cb3edbed56b8a23 not found: ID does not exist"
Sep 09 18:59:20.948706 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.948651    2561 scope.go:117] "RemoveContainer" containerID="2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"
Sep 09 18:59:20.948939 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:59:20.948922    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79\": container with ID starting with 2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79 not found: ID does not exist" containerID="2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"
Sep 09 18:59:20.948981 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.948946    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79"} err="failed to get container status \"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79\": rpc error: code = NotFound desc = could not find container \"2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79\": container with ID starting with 2f224c59b0dcb0b493c244a1970845ca4a6996be7741a32622b5846022cfcf79 not found: ID does not exist"
Sep 09 18:59:20.950647 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.950628    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:59:20.956322 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:20.956303    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-79b1ac-openshift-default-6795df9d8b-n9n57"]
Sep 09 18:59:21.017067 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:21.017033    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggxfw\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-kube-api-access-ggxfw\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:21.017067 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:21.017063    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb72399-1720-4306-b26f-af043a63bc1c-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:21.017067 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:21.017072    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb72399-1720-4306-b26f-af043a63bc1c-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:21.017289 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:21.017080    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb72399-1720-4306-b26f-af043a63bc1c-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:22.609094 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:22.609052    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" path="/var/lib/kubelet/pods/2eb72399-1720-4306-b26f-af043a63bc1c/volumes"
Sep 09 18:59:23.306134 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:23.306087    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:59:31.395649 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.395602    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:59:31.396126 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.395860    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" podUID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" containerName="maas-api" containerID="cri-o://1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687" gracePeriod=30
Sep 09 18:59:31.653298 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.653235    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:59:31.723727 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.723692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca\") pod \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") "
Sep 09 18:59:31.723894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.723791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs\") pod \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") "
Sep 09 18:59:31.723894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.723813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") pod \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") "
Sep 09 18:59:31.723894 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.723843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lph4c\" (UniqueName: \"kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c\") pod \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\" (UID: \"c4b179e3-4beb-42f0-9abd-bfbdb216701c\") "
Sep 09 18:59:31.724121 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.724093    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4b179e3-4beb-42f0-9abd-bfbdb216701c" (UID: "c4b179e3-4beb-42f0-9abd-bfbdb216701c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:59:31.724241 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.724219    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b179e3-4beb-42f0-9abd-bfbdb216701c-openshift-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:31.726100 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.726070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c" (OuterVolumeSpecName: "kube-api-access-lph4c") pod "c4b179e3-4beb-42f0-9abd-bfbdb216701c" (UID: "c4b179e3-4beb-42f0-9abd-bfbdb216701c"). InnerVolumeSpecName "kube-api-access-lph4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:59:31.726100 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.726090    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4b179e3-4beb-42f0-9abd-bfbdb216701c" (UID: "c4b179e3-4beb-42f0-9abd-bfbdb216701c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:59:31.726223 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.726142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4b179e3-4beb-42f0-9abd-bfbdb216701c" (UID: "c4b179e3-4beb-42f0-9abd-bfbdb216701c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 18:59:31.825279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.825247    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-metrics-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:31.825279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.825275    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4b179e3-4beb-42f0-9abd-bfbdb216701c-maas-api-tls\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:31.825279 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:31.825287    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lph4c\" (UniqueName: \"kubernetes.io/projected/c4b179e3-4beb-42f0-9abd-bfbdb216701c-kube-api-access-lph4c\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:32.008962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.008867    2561 generic.go:356] "Generic (PLEG): container finished" podID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" containerID="1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687" exitCode=0
Sep 09 18:59:32.008962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.008912    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"
Sep 09 18:59:32.008962 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.008948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" event={"ID":"c4b179e3-4beb-42f0-9abd-bfbdb216701c","Type":"ContainerDied","Data":"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"}
Sep 09 18:59:32.009231 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.008996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s" event={"ID":"c4b179e3-4beb-42f0-9abd-bfbdb216701c","Type":"ContainerDied","Data":"c3db51b1997fc23a35f53c173650ed78007b58fbf08d210dfb5730371a363324"}
Sep 09 18:59:32.009231 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.009018    2561 scope.go:117] "RemoveContainer" containerID="1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"
Sep 09 18:59:32.019264 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.019244    2561 scope.go:117] "RemoveContainer" containerID="1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"
Sep 09 18:59:32.019552 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:59:32.019532    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687\": container with ID starting with 1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687 not found: ID does not exist" containerID="1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"
Sep 09 18:59:32.019618 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.019560    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687"} err="failed to get container status \"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687\": rpc error: code = NotFound desc = could not find container \"1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687\": container with ID starting with 1d64b36c4df4aa64005b181493b13aa126198a84e3cd7a3934809d096c834687 not found: ID does not exist"
Sep 09 18:59:32.032429 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.032405    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:59:32.038740 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.038718    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8fbc9c-5c545546f8-kc49s"]
Sep 09 18:59:32.609998 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:32.609964    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" path="/var/lib/kubelet/pods/c4b179e3-4beb-42f0-9abd-bfbdb216701c/volumes"
Sep 09 18:59:35.506882 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:35.506846    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:59:38.416726 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.416691    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:59:38.417175 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.416987    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy" containerID="cri-o://9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5" gracePeriod=30
Sep 09 18:59:38.810563 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810482    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"]
Sep 09 18:59:38.810890 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" containerName="maas-api"
Sep 09 18:59:38.810933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810892    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" containerName="maas-api"
Sep 09 18:59:38.810933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810913    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:38.810933 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810918    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:38.811033 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.810989    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:38.811033 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.811000    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:38.811033 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.811009    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b179e3-4beb-42f0-9abd-bfbdb216701c" containerName="maas-api"
Sep 09 18:59:38.816722 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.816695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:38.819837 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.819808    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:59:38.820316 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.820021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:59:38.823693 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.823668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"]
Sep 09 18:59:38.891078 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.891039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj\" (UID: \"15a07f5d-697c-4f13-b2cf-615c8f418986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:38.991679 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.991646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj\" (UID: \"15a07f5d-697c-4f13-b2cf-615c8f418986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:38.992226 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:38.992205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj\" (UID: \"15a07f5d-697c-4f13-b2cf-615c8f418986\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:39.129248 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:39.129161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:39.413823 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:39.413795    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"]
Sep 09 18:59:39.415127 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:59:39.415098    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a07f5d_697c_4f13_b2cf_615c8f418986.slice/crio-beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b WatchSource:0}: Error finding container beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b: Status 404 returned error can't find the container with id beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b
Sep 09 18:59:40.063590 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:40.063261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj" event={"ID":"15a07f5d-697c-4f13-b2cf-615c8f418986","Type":"ContainerStarted","Data":"cd475700a16bb4618f2263eec70ca8142b7e8df01ba5a86c4bb89c7b5e9a33b0"}
Sep 09 18:59:40.063590 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:40.063328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj" event={"ID":"15a07f5d-697c-4f13-b2cf-615c8f418986","Type":"ContainerStarted","Data":"beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b"}
Sep 09 18:59:40.078851 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:40.078802    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj" podStartSLOduration=2.078786194 podStartE2EDuration="2.078786194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:59:40.077776132 +0000 UTC m=+1675.940713840" watchObservedRunningTime="2026-09-09 18:59:40.078786194 +0000 UTC m=+1675.941723892"
Sep 09 18:59:41.070971 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:41.070936    2561 generic.go:356] "Generic (PLEG): container finished" podID="15a07f5d-697c-4f13-b2cf-615c8f418986" containerID="cd475700a16bb4618f2263eec70ca8142b7e8df01ba5a86c4bb89c7b5e9a33b0" exitCode=0
Sep 09 18:59:41.070971 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:41.070975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj" event={"ID":"15a07f5d-697c-4f13-b2cf-615c8f418986","Type":"ContainerDied","Data":"cd475700a16bb4618f2263eec70ca8142b7e8df01ba5a86c4bb89c7b5e9a33b0"}
Sep 09 18:59:42.215497 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:42.215470    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:42.327190 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:42.327108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca\") pod \"15a07f5d-697c-4f13-b2cf-615c8f418986\" (UID: \"15a07f5d-697c-4f13-b2cf-615c8f418986\") "
Sep 09 18:59:42.327476 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:42.327454    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15a07f5d-697c-4f13-b2cf-615c8f418986" (UID: "15a07f5d-697c-4f13-b2cf-615c8f418986"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:59:42.428284 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:42.428249    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a07f5d-697c-4f13-b2cf-615c8f418986-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.083622 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.083589    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"
Sep 09 18:59:43.083804 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.083625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj" event={"ID":"15a07f5d-697c-4f13-b2cf-615c8f418986","Type":"ContainerDied","Data":"beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b"}
Sep 09 18:59:43.083804 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.083703    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beee5b263bc20fa3da1c35dfe602c67b01e4c8c5963a2473068c6a4c6445531b"
Sep 09 18:59:43.674898 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.674875    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:59:43.741490 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741496    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741525    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741564    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741632    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741669 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47sx9\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741673    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741768    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo\") pod \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\" (UID: \"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f\") "
Sep 09 18:59:43.741947 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:43.742250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.741954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:43.742250 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.742235    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.742356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.742255    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.742356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.742270    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.742356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.742284    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.742356 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.742282    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:59:43.743939 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.743912    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:59:43.744444 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.744387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9" (OuterVolumeSpecName: "kube-api-access-47sx9") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "kube-api-access-47sx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 18:59:43.744567 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.744480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 18:59:43.744567 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.744548    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" (UID: "a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 18:59:43.843336 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.843293    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.843336 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.843337    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.843552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.843351    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47sx9\" (UniqueName: \"kubernetes.io/projected/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-kube-api-access-47sx9\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.843552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.843365    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:43.843552 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:43.843380    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 18:59:44.091884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.091791    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerID="9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5" exitCode=0
Sep 09 18:59:44.091884 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.091839    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"
Sep 09 18:59:44.092084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.091876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerDied","Data":"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"}
Sep 09 18:59:44.092084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.091935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc" event={"ID":"a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f","Type":"ContainerDied","Data":"b586ac81f6b2732f47220f68513c0923984e1fd1be2891a2cd1449bbd53c84f4"}
Sep 09 18:59:44.092084 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.091958    2561 scope.go:117] "RemoveContainer" containerID="9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"
Sep 09 18:59:44.101966 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.101947    2561 scope.go:117] "RemoveContainer" containerID="d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"
Sep 09 18:59:44.110449 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.110428    2561 scope.go:117] "RemoveContainer" containerID="9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"
Sep 09 18:59:44.110719 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:59:44.110700    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5\": container with ID starting with 9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5 not found: ID does not exist" containerID="9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"
Sep 09 18:59:44.110772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.110729    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5"} err="failed to get container status \"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5\": rpc error: code = NotFound desc = could not find container \"9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5\": container with ID starting with 9c7c0740dcb2fee33c8e5c4c32da2e00a0b3da37834cd8ae8804a90ca3dae5f5 not found: ID does not exist"
Sep 09 18:59:44.110772 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.110745    2561 scope.go:117] "RemoveContainer" containerID="d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"
Sep 09 18:59:44.110998 ip-10-0-135-73 kubenswrapper[2561]: E0909 18:59:44.110982    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd\": container with ID starting with d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd not found: ID does not exist" containerID="d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"
Sep 09 18:59:44.111035 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.111003    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd"} err="failed to get container status \"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd\": rpc error: code = NotFound desc = could not find container \"d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd\": container with ID starting with d83293cde39a79e751cc2b593117c570686f6c8a9257ba47366c1210b32fa1fd not found: ID does not exist"
Sep 09 18:59:44.114742 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.114719    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:59:44.118761 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.118739    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8fbc9c-openshift-default-dcd9c6856-wnfxc"]
Sep 09 18:59:44.609409 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.609363    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" path="/var/lib/kubelet/pods/a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f/volumes"
Sep 09 18:59:44.963475 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:44.963436    2561 scope.go:117] "RemoveContainer" containerID="ce3b4c40acb27e8da9cf1bf8c02801bc1328e75c2d8fa01d4593aefbb84002ea"
Sep 09 18:59:49.504858 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:49.504824    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"]
Sep 09 18:59:49.507345 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:49.507325    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0daf23-zcmkj"]
Sep 09 18:59:49.707901 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:49.707862    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 18:59:50.609188 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:50.609145    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a07f5d-697c-4f13-b2cf-615c8f418986" path="/var/lib/kubelet/pods/15a07f5d-697c-4f13-b2cf-615c8f418986/volumes"
Sep 09 18:59:55.840533 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:55.840494    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 18:59:55.841141 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:55.840760    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy" containerID="cri-o://6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484" gracePeriod=30
Sep 09 18:59:56.198934 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.198893    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"]
Sep 09 18:59:56.199320 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199307    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199321    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199330    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199335    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199345    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a07f5d-697c-4f13-b2cf-615c8f418986" containerName="revoke-keys"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199350    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a07f5d-697c-4f13-b2cf-615c8f418986" containerName="revoke-keys"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199359    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:56.199386 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199364    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb72399-1720-4306-b26f-af043a63bc1c" containerName="istio-proxy"
Sep 09 18:59:56.199634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199441    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.199634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199449    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a07f5d-697c-4f13-b2cf-615c8f418986" containerName="revoke-keys"
Sep 09 18:59:56.199634 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.199456    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfdfd7-dd40-468c-ac42-7f92e8b10d4f" containerName="istio-proxy"
Sep 09 18:59:56.202992 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.202974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:56.205463 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.205440    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 18:59:56.205587 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.205480    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 18:59:56.209283 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.209261    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"]
Sep 09 18:59:56.367237 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.367201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn\" (UID: \"6f9247d0-db21-4d95-af2f-940f00ab35cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:56.468192 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.468099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn\" (UID: \"6f9247d0-db21-4d95-af2f-940f00ab35cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:56.468739 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.468719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn\" (UID: \"6f9247d0-db21-4d95-af2f-940f00ab35cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:56.514883 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.514853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:56.790462 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:56.790436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"]
Sep 09 18:59:56.791998 ip-10-0-135-73 kubenswrapper[2561]: W0909 18:59:56.791969    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9247d0_db21_4d95_af2f_940f00ab35cf.slice/crio-7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab WatchSource:0}: Error finding container 7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab: Status 404 returned error can't find the container with id 7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab
Sep 09 18:59:57.185268 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:57.185232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn" event={"ID":"6f9247d0-db21-4d95-af2f-940f00ab35cf","Type":"ContainerStarted","Data":"df0a123a76ab07fd3d7a8d233d0e2c39e2d3cdf79b2f93c3e9e5ea10c9bbccef"}
Sep 09 18:59:57.185713 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:57.185322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn" event={"ID":"6f9247d0-db21-4d95-af2f-940f00ab35cf","Type":"ContainerStarted","Data":"7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab"}
Sep 09 18:59:57.201310 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:57.201263    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn" podStartSLOduration=1.201248669 podStartE2EDuration="1.201248669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 18:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 18:59:57.199770235 +0000 UTC m=+1693.062707956" watchObservedRunningTime="2026-09-09 18:59:57.201248669 +0000 UTC m=+1693.064186367"
Sep 09 18:59:58.193204 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:58.193169    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f9247d0-db21-4d95-af2f-940f00ab35cf" containerID="df0a123a76ab07fd3d7a8d233d0e2c39e2d3cdf79b2f93c3e9e5ea10c9bbccef" exitCode=0
Sep 09 18:59:58.193619 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:58.193259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn" event={"ID":"6f9247d0-db21-4d95-af2f-940f00ab35cf","Type":"ContainerDied","Data":"df0a123a76ab07fd3d7a8d233d0e2c39e2d3cdf79b2f93c3e9e5ea10c9bbccef"}
Sep 09 18:59:59.332465 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:59.332441    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 18:59:59.499881 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:59.499785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca\") pod \"6f9247d0-db21-4d95-af2f-940f00ab35cf\" (UID: \"6f9247d0-db21-4d95-af2f-940f00ab35cf\") "
Sep 09 18:59:59.500187 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:59.500163    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f9247d0-db21-4d95-af2f-940f00ab35cf" (UID: "6f9247d0-db21-4d95-af2f-940f00ab35cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 18:59:59.601556 ip-10-0-135-73 kubenswrapper[2561]: I0909 18:59:59.601516    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9247d0-db21-4d95-af2f-940f00ab35cf-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:00.140440 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.140388    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"]
Sep 09 19:00:00.141029 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.141004    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9247d0-db21-4d95-af2f-940f00ab35cf" containerName="revoke-keys"
Sep 09 19:00:00.141218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.141200    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9247d0-db21-4d95-af2f-940f00ab35cf" containerName="revoke-keys"
Sep 09 19:00:00.141534 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.141515    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9247d0-db21-4d95-af2f-940f00ab35cf" containerName="revoke-keys"
Sep 09 19:00:00.145315 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.145295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"
Sep 09 19:00:00.145631 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.145607    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"]
Sep 09 19:00:00.149283 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.149265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"
Sep 09 19:00:00.155998 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.155960    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"]
Sep 09 19:00:00.160069 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.160049    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"
Sep 09 19:00:00.163678 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.163659    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"]
Sep 09 19:00:00.169096 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.169081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"
Sep 09 19:00:00.209927 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.209888    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"
Sep 09 19:00:00.210116 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.209884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn" event={"ID":"6f9247d0-db21-4d95-af2f-940f00ab35cf","Type":"ContainerDied","Data":"7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab"}
Sep 09 19:00:00.210116 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.210028    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dc2dbddb52ceb5dd23bcba14b083843fad0b8266ef6072afcdee9440d3f15ab"
Sep 09 19:00:00.446978 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.446951    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"]
Sep 09 19:00:00.449004 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:00:00.448972    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31aa34f6_594a_4d47_992c_ac776b167505.slice/crio-3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e WatchSource:0}: Error finding container 3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e: Status 404 returned error can't find the container with id 3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e
Sep 09 19:00:00.456852 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.456808    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"]
Sep 09 19:00:00.458203 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:00:00.458168    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2504369c_4fb2_4b77_b849_4f5b9e0f26de.slice/crio-595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb WatchSource:0}: Error finding container 595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb: Status 404 returned error can't find the container with id 595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb
Sep 09 19:00:00.597313 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:00.597276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:00:01.081924 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.081897    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 19:00:01.218209 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218174    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218209 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218209    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pmtl\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218250    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218288    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218309    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218342    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218763 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218501    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218763 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert\") pod \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\" (UID: \"19a3c347-c2e3-4540-8f70-bea7f0b63e06\") "
Sep 09 19:00:01.218868 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218784    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:01.218927 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218894    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data" (OuterVolumeSpecName: "istio-data") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:01.218927 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218913    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.219033 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218913    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:01.219033 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.218986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:01.219156 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.219130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:00:01.221041 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221015    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token" (OuterVolumeSpecName: "istio-token") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:00:01.221296 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221268    2561 generic.go:356] "Generic (PLEG): container finished" podID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerID="6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484" exitCode=0
Sep 09 19:00:01.221536 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:01.221536 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221343    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"
Sep 09 19:00:01.221696 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221489    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:00:01.221696 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerDied","Data":"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"}
Sep 09 19:00:01.221805 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9" event={"ID":"19a3c347-c2e3-4540-8f70-bea7f0b63e06","Type":"ContainerDied","Data":"967f5a7fd428d221bf34040f828d9776719d81db0cb65dd6ad1244d0afba1fe9"}
Sep 09 19:00:01.221805 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221746    2561 scope.go:117] "RemoveContainer" containerID="6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"
Sep 09 19:00:01.222020 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.221992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl" (OuterVolumeSpecName: "kube-api-access-9pmtl") pod "19a3c347-c2e3-4540-8f70-bea7f0b63e06" (UID: "19a3c347-c2e3-4540-8f70-bea7f0b63e06"). InnerVolumeSpecName "kube-api-access-9pmtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:00:01.223613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.223587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w" event={"ID":"2504369c-4fb2-4b77-b849-4f5b9e0f26de","Type":"ContainerStarted","Data":"47d9760de81bf69b4e647253affbe5060c61603f4bd66270e2bd88b68f1e6429"}
Sep 09 19:00:01.223727 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.223646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w" event={"ID":"2504369c-4fb2-4b77-b849-4f5b9e0f26de","Type":"ContainerStarted","Data":"595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb"}
Sep 09 19:00:01.225783 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.225759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx" event={"ID":"31aa34f6-594a-4d47-992c-ac776b167505","Type":"ContainerStarted","Data":"c99512956c7baea37fe7fdde8e80aacf702e41beb25e180c2d2ea74f625b7708"}
Sep 09 19:00:01.225901 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.225830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx" event={"ID":"31aa34f6-594a-4d47-992c-ac776b167505","Type":"ContainerStarted","Data":"3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e"}
Sep 09 19:00:01.234283 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.234261    2561 scope.go:117] "RemoveContainer" containerID="fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"
Sep 09 19:00:01.240388 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.240333    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx" podStartSLOduration=1.2403160579999999 podStartE2EDuration="1.240316058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:00:01.239659313 +0000 UTC m=+1697.102597011" watchObservedRunningTime="2026-09-09 19:00:01.240316058 +0000 UTC m=+1697.103253758"
Sep 09 19:00:01.245803 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.245777    2561 scope.go:117] "RemoveContainer" containerID="6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"
Sep 09 19:00:01.246225 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:01.246197    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484\": container with ID starting with 6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484 not found: ID does not exist" containerID="6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"
Sep 09 19:00:01.246346 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.246237    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484"} err="failed to get container status \"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484\": rpc error: code = NotFound desc = could not find container \"6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484\": container with ID starting with 6c341e5b40839432c5baf2556ba0295db9ffaf3eb04e513ccd7450ed20e57484 not found: ID does not exist"
Sep 09 19:00:01.246346 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.246264    2561 scope.go:117] "RemoveContainer" containerID="fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"
Sep 09 19:00:01.246666 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:01.246637    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048\": container with ID starting with fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048 not found: ID does not exist" containerID="fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"
Sep 09 19:00:01.246830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.246806    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048"} err="failed to get container status \"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048\": rpc error: code = NotFound desc = could not find container \"fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048\": container with ID starting with fbc213ffbc25b8b9e21dcc56840486318ca1f29e1f4b7c1f9fe80d2a940f5048 not found: ID does not exist"
Sep 09 19:00:01.256990 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.256860    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w" podStartSLOduration=1.256836236 podStartE2EDuration="1.256836236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:00:01.253013882 +0000 UTC m=+1697.115951584" watchObservedRunningTime="2026-09-09 19:00:01.256836236 +0000 UTC m=+1697.119773935"
Sep 09 19:00:01.320222 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320158    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320222 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320214    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320222 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320228    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320240    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pmtl\" (UniqueName: \"kubernetes.io/projected/19a3c347-c2e3-4540-8f70-bea7f0b63e06-kube-api-access-9pmtl\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320255    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320268    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320280    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.320613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.320293    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a3c347-c2e3-4540-8f70-bea7f0b63e06-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:01.544607 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.544579    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 19:00:01.550656 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:01.550628    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0daf23-openshift-default-65d5f7767d-6ffg9"]
Sep 09 19:00:02.234280 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:02.234246    2561 generic.go:356] "Generic (PLEG): container finished" podID="2504369c-4fb2-4b77-b849-4f5b9e0f26de" containerID="47d9760de81bf69b4e647253affbe5060c61603f4bd66270e2bd88b68f1e6429" exitCode=0
Sep 09 19:00:02.234480 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:02.234324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w" event={"ID":"2504369c-4fb2-4b77-b849-4f5b9e0f26de","Type":"ContainerDied","Data":"47d9760de81bf69b4e647253affbe5060c61603f4bd66270e2bd88b68f1e6429"}
Sep 09 19:00:02.235902 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:02.235878    2561 generic.go:356] "Generic (PLEG): container finished" podID="31aa34f6-594a-4d47-992c-ac776b167505" containerID="c99512956c7baea37fe7fdde8e80aacf702e41beb25e180c2d2ea74f625b7708" exitCode=0
Sep 09 19:00:02.235999 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:02.235953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx" event={"ID":"31aa34f6-594a-4d47-992c-ac776b167505","Type":"ContainerDied","Data":"c99512956c7baea37fe7fdde8e80aacf702e41beb25e180c2d2ea74f625b7708"}
Sep 09 19:00:02.610030 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:02.609945    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" path="/var/lib/kubelet/pods/19a3c347-c2e3-4540-8f70-bea7f0b63e06/volumes"
Sep 09 19:00:03.405828 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:03.405804    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"
Sep 09 19:00:03.407918 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:03.407896    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"
Sep 09 19:00:04.249236 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.249199    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"
Sep 09 19:00:04.249680 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.249211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx" event={"ID":"31aa34f6-594a-4d47-992c-ac776b167505","Type":"ContainerDied","Data":"3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e"}
Sep 09 19:00:04.249680 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.249379    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e8cfa542da75f8483ca1243816778ba045683ac00c3520a9a37c074bfceec6e"
Sep 09 19:00:04.250725 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.250702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w" event={"ID":"2504369c-4fb2-4b77-b849-4f5b9e0f26de","Type":"ContainerDied","Data":"595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb"}
Sep 09 19:00:04.250842 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.250739    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="595aa935fd4d7277a1d437d72f1ded7b40cde681a880f00ab17aa47e6ca283cb"
Sep 09 19:00:04.250842 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:04.250712    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816340-7j88w"
Sep 09 19:00:06.723199 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:06.723160    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"]
Sep 09 19:00:06.727381 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:06.727351    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-c09a03-29816340-6j5fx"]
Sep 09 19:00:06.943976 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:06.943887    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"]
Sep 09 19:00:06.949945 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:06.949912    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c09a03-6s4tn"]
Sep 09 19:00:08.610537 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:08.610506    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31aa34f6-594a-4d47-992c-ac776b167505" path="/var/lib/kubelet/pods/31aa34f6-594a-4d47-992c-ac776b167505/volumes"
Sep 09 19:00:08.611070 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:08.610986    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9247d0-db21-4d95-af2f-940f00ab35cf" path="/var/lib/kubelet/pods/6f9247d0-db21-4d95-af2f-940f00ab35cf/volumes"
Sep 09 19:00:10.375607 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.375566    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.375981    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.375992    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376009    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2504369c-4fb2-4b77-b849-4f5b9e0f26de" containerName="cleanup"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376015    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2504369c-4fb2-4b77-b849-4f5b9e0f26de" containerName="cleanup"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376024    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31aa34f6-594a-4d47-992c-ac776b167505" containerName="cleanup"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376030    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="31aa34f6-594a-4d47-992c-ac776b167505" containerName="cleanup"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376038    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376084 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376044    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376617 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376104    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376617 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376113    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a3c347-c2e3-4540-8f70-bea7f0b63e06" containerName="istio-proxy"
Sep 09 19:00:10.376617 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376120    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="31aa34f6-594a-4d47-992c-ac776b167505" containerName="cleanup"
Sep 09 19:00:10.376617 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.376127    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2504369c-4fb2-4b77-b849-4f5b9e0f26de" containerName="cleanup"
Sep 09 19:00:10.379462 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.379440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.381657 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.381633    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a63380-openshift-default-dockercfg-tq2mj\""
Sep 09 19:00:10.391719 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.391692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:00:10.410258 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410464 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410464 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410464 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410464 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410464 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410721 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jwgk\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410721 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.410721 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.410653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511459 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511459 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511715 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511715 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511715 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511715 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511715 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwgk\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511996 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511996 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511996 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.511996 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.511911    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.512218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.512039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.512218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.512082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.512218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.512169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.514045 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.514023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.514152 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.514093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.519761 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.519731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.519943 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.519924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jwgk\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk\") pod \"e2e-ipp-a-a63380-openshift-default-576887659b-72b8n\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") " pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.690189 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.690152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:10.968119 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.968089    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:00:10.970510 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:00:10.970479    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d83870_6140_4663_8ae0_d0d9edd4c4ef.slice/crio-abefafa7185d515efd0e044da9cace36ed6b49bc12023ac1ddebe4eca1639a1d WatchSource:0}: Error finding container abefafa7185d515efd0e044da9cace36ed6b49bc12023ac1ddebe4eca1639a1d: Status 404 returned error can't find the container with id abefafa7185d515efd0e044da9cace36ed6b49bc12023ac1ddebe4eca1639a1d
Sep 09 19:00:10.972768 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.972730    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:10.972852 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.972801    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:10.972886 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:10.972848    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:11.298204 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:11.298108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerStarted","Data":"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"}
Sep 09 19:00:11.298204 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:11.298165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerStarted","Data":"abefafa7185d515efd0e044da9cace36ed6b49bc12023ac1ddebe4eca1639a1d"}
Sep 09 19:00:11.322409 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:11.322342    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podStartSLOduration=1.322326536 podStartE2EDuration="1.322326536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:00:11.31927452 +0000 UTC m=+1707.182212217" watchObservedRunningTime="2026-09-09 19:00:11.322326536 +0000 UTC m=+1707.185264234"
Sep 09 19:00:11.690705 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:11.690672    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:12.100912 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:12.100818    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:00:12.696514 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:12.696477    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:13.312124 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:13.312091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:13.313041 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:13.313022    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:13.900770 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:13.900726    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 19:00:13.901260 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:13.900942    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy" containerID="cri-o://7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b" gracePeriod=30
Sep 09 19:00:19.154017 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.153989    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 19:00:19.198830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198836    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198926    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198954    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198963    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:19.198987 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.198978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmfsp\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.199309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.199309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199080    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.199309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs\") pod \"1c732887-971e-4b02-8d4c-8c4165718e56\" (UID: \"1c732887-971e-4b02-8d4c-8c4165718e56\") "
Sep 09 19:00:19.199309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199232    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:19.199309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199294    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:00:19.199596 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199484    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:19.199596 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199537    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c732887-971e-4b02-8d4c-8c4165718e56-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.199596 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199556    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.199596 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199571    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.199806 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.199700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:19.201265 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.201239    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:00:19.201590 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.201564    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:00:19.201718 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.201701    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:00:19.201787 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.201765    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp" (OuterVolumeSpecName: "kube-api-access-xmfsp") pod "1c732887-971e-4b02-8d4c-8c4165718e56" (UID: "1c732887-971e-4b02-8d4c-8c4165718e56"). InnerVolumeSpecName "kube-api-access-xmfsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:00:19.300989 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.300955    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.300989 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.300983    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c732887-971e-4b02-8d4c-8c4165718e56-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.300989 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.300992    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.301225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.301002    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c732887-971e-4b02-8d4c-8c4165718e56-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.301225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.301011    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.301225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.301018    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmfsp\" (UniqueName: \"kubernetes.io/projected/1c732887-971e-4b02-8d4c-8c4165718e56-kube-api-access-xmfsp\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:00:19.354494 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.354457    2561 generic.go:356] "Generic (PLEG): container finished" podID="1c732887-971e-4b02-8d4c-8c4165718e56" containerID="7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b" exitCode=0
Sep 09 19:00:19.354649 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.354519    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"
Sep 09 19:00:19.354649 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.354551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerDied","Data":"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"}
Sep 09 19:00:19.354649 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.354607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh" event={"ID":"1c732887-971e-4b02-8d4c-8c4165718e56","Type":"ContainerDied","Data":"d6843d7e670265f409357187e6eb2da77b460652d2c50f35f133c8cc6acd270a"}
Sep 09 19:00:19.354649 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.354630    2561 scope.go:117] "RemoveContainer" containerID="7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"
Sep 09 19:00:19.371895 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.371874    2561 scope.go:117] "RemoveContainer" containerID="2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"
Sep 09 19:00:19.381454 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.381431    2561 scope.go:117] "RemoveContainer" containerID="7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"
Sep 09 19:00:19.381737 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:19.381712    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b\": container with ID starting with 7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b not found: ID does not exist" containerID="7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"
Sep 09 19:00:19.381832 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.381745    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b"} err="failed to get container status \"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b\": rpc error: code = NotFound desc = could not find container \"7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b\": container with ID starting with 7fa55db02cb4732c41f708202e6785daf8b41fad2f1afdf05ee65e058c7f7c2b not found: ID does not exist"
Sep 09 19:00:19.381832 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.381763    2561 scope.go:117] "RemoveContainer" containerID="2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"
Sep 09 19:00:19.381937 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.381888    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 19:00:19.382041 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:19.382009    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc\": container with ID starting with 2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc not found: ID does not exist" containerID="2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"
Sep 09 19:00:19.382078 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.382047    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc"} err="failed to get container status \"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc\": rpc error: code = NotFound desc = could not find container \"2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc\": container with ID starting with 2b9c2f7b59253b57efb401a3cd3bbc463f2b4eedfb14caf41f676339e2ad0ecc not found: ID does not exist"
Sep 09 19:00:19.387862 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:19.387837    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c09a03-openshift-default-68c7cbc8d-x48sh"]
Sep 09 19:00:20.609215 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:20.609180    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" path="/var/lib/kubelet/pods/1c732887-971e-4b02-8d4c-8c4165718e56/volumes"
Sep 09 19:00:26.198410 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:26.198360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:00:28.313527 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.313498    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:28.313890 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.313563    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:28.418478 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.418443    2561 generic.go:356] "Generic (PLEG): container finished" podID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerID="7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5" exitCode=0
Sep 09 19:00:28.418653 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.418524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerDied","Data":"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"}
Sep 09 19:00:28.418996 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.418980    2561 scope.go:117] "RemoveContainer" containerID="7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"
Sep 09 19:00:28.420090 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.420060    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:28.420164 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.420147    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:28.420215 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:28.420199    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:29.426438 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:29.426386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerStarted","Data":"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"}
Sep 09 19:00:29.691017 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:29.690915    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:29.691194 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:29.691171    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:29.691248 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:29.691218    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:30.691539 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:30.691505    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:30.692078 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:30.691586    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:31.690830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:31.690789    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:31.691047 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:31.690859    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:32.690747 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:32.690704    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:32.691237 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:32.690773    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:33.691581 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:33.691543    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:33.691975 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:33.691602    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:34.691185 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:34.691150    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 09 19:00:34.691379 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:34.691220    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 09 19:00:35.694561 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:35.694528    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:35.695043 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:35.694914    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:35.695457 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:35.695436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:00:39.147410 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.147349    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:00:39.148024 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.148000    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:39.148170 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.148100    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:39.148289 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.148275    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:39.150274 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.150253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.152723 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.152700    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-03128a-openshift-default-dockercfg-7mvgz\""
Sep 09 19:00:39.165584 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.165557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:00:39.220009 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.219973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220175 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7llp\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220175 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220175 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220175 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220313 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220313 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220313 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.220313 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.220307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321370 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321370 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.321643 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7llp\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.322029 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.322029 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.322029 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.321948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.322206 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.322060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.322290 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.322267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.323856 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.323838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.324000 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.323982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.329044 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.329019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.329493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.329472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7llp\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp\") pod \"e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") " pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.462654 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.462569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:39.740254 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.740231    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:00:39.741866 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:00:39.741841    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb4160f_24f5_4502_b236_a3e6cb600458.slice/crio-7786e1d7e0283961b997ee302bae76ba4e6f13a2bce50d019d40d64c2d3de37a WatchSource:0}: Error finding container 7786e1d7e0283961b997ee302bae76ba4e6f13a2bce50d019d40d64c2d3de37a: Status 404 returned error can't find the container with id 7786e1d7e0283961b997ee302bae76ba4e6f13a2bce50d019d40d64c2d3de37a
Sep 09 19:00:39.744077 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.744043    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:39.744188 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.744123    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:39.744188 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:39.744167    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:00:40.504903 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:40.504868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerStarted","Data":"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"}
Sep 09 19:00:40.505308 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:40.504923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerStarted","Data":"7786e1d7e0283961b997ee302bae76ba4e6f13a2bce50d019d40d64c2d3de37a"}
Sep 09 19:00:40.529638 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:40.529589    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podStartSLOduration=1.529572778 podStartE2EDuration="1.529572778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:00:40.526987446 +0000 UTC m=+1736.389925164" watchObservedRunningTime="2026-09-09 19:00:40.529572778 +0000 UTC m=+1736.392510475"
Sep 09 19:00:41.462856 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:41.462823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:41.467940 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:41.467911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:41.510722 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:41.510683    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:41.511722 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:41.511705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:00:43.666695 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.666654    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:00:43.667607 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.667558    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:43.667607 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.667608    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:43.667854 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.667838    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c732887-971e-4b02-8d4c-8c4165718e56" containerName="istio-proxy"
Sep 09 19:00:43.671122 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.671099    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.674304 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.674236    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-03128a-serving-cert\""
Sep 09 19:00:43.674473 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.674304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wsrn9\""
Sep 09 19:00:43.674473 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.674240    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 19:00:43.674473 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.674257    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 19:00:43.674473 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.674273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 19:00:43.679515 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.679490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:00:43.768793 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.768758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.768970 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.768808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.768970 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.768905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.768970 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.768952    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwk2\" (UniqueName: \"kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.870237 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.870196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.870452 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.870248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.870452 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.870286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.870452 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.870318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwk2\" (UniqueName: \"kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.870452 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:43.870372    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-serving-cert: secret "maas-api-e2e-ipp-b-03128a-serving-cert" not found
Sep 09 19:00:43.870680 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:00:43.870480    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls podName:7d89a790-6a6b-4f54-bfbf-9a4976362f8f nodeName:}" failed. No retries permitted until 2026-09-09 19:00:44.370458534 +0000 UTC m=+1740.233396211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls") pod "maas-api-e2e-ipp-b-03128a-645947d56f-5t684" (UID: "7d89a790-6a6b-4f54-bfbf-9a4976362f8f") : secret "maas-api-e2e-ipp-b-03128a-serving-cert" not found
Sep 09 19:00:43.870989 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.870969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.872714 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.872698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:43.878430 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:43.878382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwk2\" (UniqueName: \"kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:44.375866 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:44.375826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:44.378269 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:44.378236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-03128a-645947d56f-5t684\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:44.586999 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:44.586968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wsrn9\""
Sep 09 19:00:44.596028 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:44.596002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:44.876463 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:44.876435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:00:44.878453 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:00:44.878419    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d89a790_6a6b_4f54_bfbf_9a4976362f8f.slice/crio-fca9137b65fad0e2aeaae6d7930391199491ca343d787f36c0b0d456c9ecd8dc WatchSource:0}: Error finding container fca9137b65fad0e2aeaae6d7930391199491ca343d787f36c0b0d456c9ecd8dc: Status 404 returned error can't find the container with id fca9137b65fad0e2aeaae6d7930391199491ca343d787f36c0b0d456c9ecd8dc
Sep 09 19:00:45.535146 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:45.535037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" event={"ID":"7d89a790-6a6b-4f54-bfbf-9a4976362f8f","Type":"ContainerStarted","Data":"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"}
Sep 09 19:00:45.535336 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:45.535202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:00:45.535336 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:45.535239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" event={"ID":"7d89a790-6a6b-4f54-bfbf-9a4976362f8f","Type":"ContainerStarted","Data":"fca9137b65fad0e2aeaae6d7930391199491ca343d787f36c0b0d456c9ecd8dc"}
Sep 09 19:00:45.554103 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:45.554035    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" podStartSLOduration=2.185626476 podStartE2EDuration="2.554012385s" totalImagesPullingTime="368.385909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:00:45.553441003 +0000 UTC m=+1741.416378725" watchObservedRunningTime="2026-09-09 19:00:45.554012385 +0000 UTC m=+1741.416950084"
Sep 09 19:00:50.303462 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:50.303428    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:00:51.546456 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:00:51.546426    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:01:01.640501 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.640465    2561 generic.go:356] "Generic (PLEG): container finished" podID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerID="90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397" exitCode=0
Sep 09 19:01:01.640929 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.640540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerDied","Data":"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"}
Sep 09 19:01:01.640995 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.640980    2561 scope.go:117] "RemoveContainer" containerID="90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"
Sep 09 19:01:01.642259 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.642233    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:01.642319 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.642306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:01.642360 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:01.642336    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:02.652982 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:02.652940    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerStarted","Data":"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"}
Sep 09 19:01:03.463889 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:03.463855    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:01:03.464224 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:03.464199    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 19:01:03.464381 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:03.464311    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 19:01:04.464544 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:04.464491    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 19:01:04.464944 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:04.464583    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 19:01:05.463262 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:05.463220    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 19:01:05.463619 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:05.463582    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 19:01:06.463557 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:06.463507    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 19:01:06.464095 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:06.463579    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 19:01:07.463632 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:07.463589    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Sep 09 19:01:07.464137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:07.463657    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Sep 09 19:01:08.467697 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:08.467665    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:01:08.468151 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:08.467974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:01:08.468799 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:08.468782    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:01:23.299756 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:23.299716    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:01:41.906231 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:41.906152    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:01:44.731503 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:44.731476    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 19:01:44.738027 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:44.738003    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 19:01:49.147805 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.147772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:01:49.151620 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.151599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.155087 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.155065    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5ae86e-openshift-default-dockercfg-gq9kt\""
Sep 09 19:01:49.168989 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.168960    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:01:49.215270 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215650 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215650 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215650 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswjs\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.215650 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.215643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.316928 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.316893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswjs\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.316928 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.316932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317158 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.316981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317158 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317158 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317158 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317347 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317347 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317486 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317486 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317486 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317785 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317837 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.317995 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.317978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.319379 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.319356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.319631 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.319614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.325178 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.325155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.325545 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.325528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswjs\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs\") pod \"e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") " pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.462258 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.462160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:49.757355 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:01:49.757325    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e484d5_487e_4170_b961_80d1d962ee84.slice/crio-0960be6cc3f6de596dfa8055d00add217e6cdac90e480255d9f81f442c287477 WatchSource:0}: Error finding container 0960be6cc3f6de596dfa8055d00add217e6cdac90e480255d9f81f442c287477: Status 404 returned error can't find the container with id 0960be6cc3f6de596dfa8055d00add217e6cdac90e480255d9f81f442c287477
Sep 09 19:01:49.758028 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.757916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:01:49.759968 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.759925    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:49.760061 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.760021    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:49.760105 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.760063    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:01:49.958834 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.958798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerStarted","Data":"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"}
Sep 09 19:01:49.959025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.958858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerStarted","Data":"0960be6cc3f6de596dfa8055d00add217e6cdac90e480255d9f81f442c287477"}
Sep 09 19:01:49.988228 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:49.988159    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podStartSLOduration=0.988136127 podStartE2EDuration="988.136127ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:01:49.983089495 +0000 UTC m=+1805.846027217" watchObservedRunningTime="2026-09-09 19:01:49.988136127 +0000 UTC m=+1805.851073828"
Sep 09 19:01:50.462925 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:50.462878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:50.468919 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:50.468882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:50.966105 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:50.966064    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:01:50.967133 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:01:50.967113    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:00.303549 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:00.303506    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:02:11.114221 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.114181    2561 generic.go:356] "Generic (PLEG): container finished" podID="d4e484d5-487e-4170-b961-80d1d962ee84" containerID="9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7" exitCode=0
Sep 09 19:02:11.114672 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.114256    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerDied","Data":"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"}
Sep 09 19:02:11.114800 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.114781    2561 scope.go:117] "RemoveContainer" containerID="9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"
Sep 09 19:02:11.115917 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.115891    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:02:11.115976 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.115964    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:02:11.116027 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:11.116016    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 19:02:12.121710 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:12.121679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerStarted","Data":"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"}
Sep 09 19:02:12.463364 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:12.463327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:12.463670 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:12.463635    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:12.463761 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:12.463700    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:13.462779 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:13.462732    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:13.463304 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:13.462806    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:14.463483 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:14.463447    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:14.464046 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:14.464018    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:15.463309 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:15.463236    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:15.463667 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:15.463633    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:16.463457 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:16.463417    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:16.463781 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:16.463752    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:17.463462 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:17.463420    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 09 19:02:17.463652 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:17.463514    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 09 19:02:18.466752 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:18.466720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:18.467144 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:18.467123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:18.467772 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:18.467754    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:28.000166 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:28.000126    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:02:30.443101 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:30.443066    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:02:30.443579 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:30.443291    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" containerID="cri-o://91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda" gracePeriod=30
Sep 09 19:02:33.469252 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:33.469209    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 19:02:33.469748 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:33.469297    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 19:02:35.705132 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.705067    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:35.805952 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.805917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.805980    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806048    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806137 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806192    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806245    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806281    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswjs\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs\") pod \"d4e484d5-487e-4170-b961-80d1d962ee84\" (UID: \"d4e484d5-487e-4170-b961-80d1d962ee84\") "
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806567    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806568    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:02:35.806635 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806601    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806723    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806864    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e484d5-487e-4170-b961-80d1d962ee84-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806884    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806897    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806896    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:02:35.806951 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.806909    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.808366 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.808342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:02:35.808671 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.808654    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs" (OuterVolumeSpecName: "kube-api-access-wswjs") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "kube-api-access-wswjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:02:35.808801 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.808782    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:02:35.808881 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.808799    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4e484d5-487e-4170-b961-80d1d962ee84" (UID: "d4e484d5-487e-4170-b961-80d1d962ee84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:02:35.907681 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.907641    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.907681 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.907672    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e484d5-487e-4170-b961-80d1d962ee84-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.907681 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.907684    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswjs\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-kube-api-access-wswjs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.907929 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.907694    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e484d5-487e-4170-b961-80d1d962ee84-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:35.907929 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:35.907703    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e484d5-487e-4170-b961-80d1d962ee84-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:02:36.300653 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.300614    2561 generic.go:356] "Generic (PLEG): container finished" podID="d4e484d5-487e-4170-b961-80d1d962ee84" containerID="91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda" exitCode=0
Sep 09 19:02:36.300830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.300669    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"
Sep 09 19:02:36.300830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.300702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerDied","Data":"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"}
Sep 09 19:02:36.300830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.300765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5" event={"ID":"d4e484d5-487e-4170-b961-80d1d962ee84","Type":"ContainerDied","Data":"0960be6cc3f6de596dfa8055d00add217e6cdac90e480255d9f81f442c287477"}
Sep 09 19:02:36.300830 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.300795    2561 scope.go:117] "RemoveContainer" containerID="91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"
Sep 09 19:02:36.312788 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.312766    2561 scope.go:117] "RemoveContainer" containerID="9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"
Sep 09 19:02:36.322519 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.322497    2561 scope.go:117] "RemoveContainer" containerID="91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"
Sep 09 19:02:36.322861 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:02:36.322840    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda\": container with ID starting with 91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda not found: ID does not exist" containerID="91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"
Sep 09 19:02:36.322926 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.322872    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda"} err="failed to get container status \"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda\": rpc error: code = NotFound desc = could not find container \"91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda\": container with ID starting with 91f4463507eec9b2ac2f38d60f1ff45bfde78b303ef0e93b3bc1a1cb52463fda not found: ID does not exist"
Sep 09 19:02:36.322926 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.322894    2561 scope.go:117] "RemoveContainer" containerID="9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"
Sep 09 19:02:36.323215 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:02:36.323197    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7\": container with ID starting with 9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7 not found: ID does not exist" containerID="9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"
Sep 09 19:02:36.323261 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.323218    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7"} err="failed to get container status \"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7\": rpc error: code = NotFound desc = could not find container \"9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7\": container with ID starting with 9e515297c60be77fe7a5d4a1ce7530230eb04ae12fe9a36b162eaa3f2c55c3d7 not found: ID does not exist"
Sep 09 19:02:36.325030 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.325010    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:02:36.328962 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.328937    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5ae86e-openshift-default-85d554bd6d-q5qm5"]
Sep 09 19:02:36.609837 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:36.609742    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" path="/var/lib/kubelet/pods/d4e484d5-487e-4170-b961-80d1d962ee84/volumes"
Sep 09 19:02:45.031360 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:45.031325    2561 scope.go:117] "RemoveContainer" containerID="e83b3f226fa1f60335014cca82a690419f3fee9a9a0d82288b271fb1540d5468"
Sep 09 19:02:47.220264 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:02:47.220220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:03:01.201258 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:01.201222    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:03:44.175561 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:44.175524    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:03:44.176117 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:44.175826    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy" containerID="cri-o://c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f" gracePeriod=30
Sep 09 19:03:49.424781 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.424751    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:03:49.533583 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533583 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jwgk\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533650    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533730    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533777    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.533876 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533876    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket\") pod \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\" (UID: \"10d83870-6140-4663-8ae0-d0d9edd4c4ef\") "
Sep 09 19:03:49.534247 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.533987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:03:49.534247 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534065    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:03:49.534247 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:03:49.534247 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:03:49.534497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534304    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:03:49.534497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534324    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.534497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534341    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.534497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534354    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.534497 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.534367    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.535885 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.535861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:03:49.535994 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.535976    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:03:49.536277 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.536255    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk" (OuterVolumeSpecName: "kube-api-access-4jwgk") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "kube-api-access-4jwgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:03:49.536356 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.536333    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10d83870-6140-4663-8ae0-d0d9edd4c4ef" (UID: "10d83870-6140-4663-8ae0-d0d9edd4c4ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:03:49.634860 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.634822    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.634860 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.634854    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.634860 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.634864    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jwgk\" (UniqueName: \"kubernetes.io/projected/10d83870-6140-4663-8ae0-d0d9edd4c4ef-kube-api-access-4jwgk\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.635118 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.634874    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.635118 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.634883    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d83870-6140-4663-8ae0-d0d9edd4c4ef-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:49.767118 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.767079    2561 generic.go:356] "Generic (PLEG): container finished" podID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerID="c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f" exitCode=0
Sep 09 19:03:49.767317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.767130    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"
Sep 09 19:03:49.767317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.767170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerDied","Data":"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"}
Sep 09 19:03:49.767317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.767239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n" event={"ID":"10d83870-6140-4663-8ae0-d0d9edd4c4ef","Type":"ContainerDied","Data":"abefafa7185d515efd0e044da9cace36ed6b49bc12023ac1ddebe4eca1639a1d"}
Sep 09 19:03:49.767317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.767272    2561 scope.go:117] "RemoveContainer" containerID="c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"
Sep 09 19:03:49.777480 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.777461    2561 scope.go:117] "RemoveContainer" containerID="7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"
Sep 09 19:03:49.785975 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.785927    2561 scope.go:117] "RemoveContainer" containerID="c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"
Sep 09 19:03:49.786590 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:03:49.786555    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f\": container with ID starting with c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f not found: ID does not exist" containerID="c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"
Sep 09 19:03:49.786699 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.786601    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f"} err="failed to get container status \"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f\": rpc error: code = NotFound desc = could not find container \"c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f\": container with ID starting with c2cb38277529edbdbb7979e477647c5ca4efb98ebf7793a7cc39f64d407a393f not found: ID does not exist"
Sep 09 19:03:49.786699 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.786626    2561 scope.go:117] "RemoveContainer" containerID="7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"
Sep 09 19:03:49.786945 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:03:49.786921    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5\": container with ID starting with 7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5 not found: ID does not exist" containerID="7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"
Sep 09 19:03:49.787025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.786955    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5"} err="failed to get container status \"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5\": rpc error: code = NotFound desc = could not find container \"7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5\": container with ID starting with 7d1cded61464a5469cba95b6eba1b92cb83712f0d9230f8961acd39a1bc68bf5 not found: ID does not exist"
Sep 09 19:03:49.788761 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.788742    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:03:49.794280 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:49.794259    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a63380-openshift-default-576887659b-72b8n"]
Sep 09 19:03:50.610011 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:50.609975    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" path="/var/lib/kubelet/pods/10d83870-6140-4663-8ae0-d0d9edd4c4ef/volumes"
Sep 09 19:03:55.171308 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.171276    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:03:55.171827 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.171542    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" podUID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" containerName="maas-api" containerID="cri-o://78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7" gracePeriod=30
Sep 09 19:03:55.420158 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.420130    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:03:55.493191 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.493106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqwk2\" (UniqueName: \"kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2\") pod \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") "
Sep 09 19:03:55.493191 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.493148    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs\") pod \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") "
Sep 09 19:03:55.493488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.493210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca\") pod \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") "
Sep 09 19:03:55.493488 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.493283    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") pod \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\" (UID: \"7d89a790-6a6b-4f54-bfbf-9a4976362f8f\") "
Sep 09 19:03:55.493662 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.493629    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d89a790-6a6b-4f54-bfbf-9a4976362f8f" (UID: "7d89a790-6a6b-4f54-bfbf-9a4976362f8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:03:55.495285 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.495264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d89a790-6a6b-4f54-bfbf-9a4976362f8f" (UID: "7d89a790-6a6b-4f54-bfbf-9a4976362f8f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 19:03:55.495370 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.495347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2" (OuterVolumeSpecName: "kube-api-access-qqwk2") pod "7d89a790-6a6b-4f54-bfbf-9a4976362f8f" (UID: "7d89a790-6a6b-4f54-bfbf-9a4976362f8f"). InnerVolumeSpecName "kube-api-access-qqwk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:03:55.495444 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.495369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d89a790-6a6b-4f54-bfbf-9a4976362f8f" (UID: "7d89a790-6a6b-4f54-bfbf-9a4976362f8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 19:03:55.594314 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.594280    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-openshift-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:55.594314 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.594313    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-maas-api-tls\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:55.594554 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.594326    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqwk2\" (UniqueName: \"kubernetes.io/projected/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-kube-api-access-qqwk2\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:55.594554 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.594338    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d89a790-6a6b-4f54-bfbf-9a4976362f8f-metrics-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:03:55.809102 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.809012    2561 generic.go:356] "Generic (PLEG): container finished" podID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" containerID="78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7" exitCode=0
Sep 09 19:03:55.809102 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.809054    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"
Sep 09 19:03:55.809102 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.809091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" event={"ID":"7d89a790-6a6b-4f54-bfbf-9a4976362f8f","Type":"ContainerDied","Data":"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"}
Sep 09 19:03:55.809412 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.809142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684" event={"ID":"7d89a790-6a6b-4f54-bfbf-9a4976362f8f","Type":"ContainerDied","Data":"fca9137b65fad0e2aeaae6d7930391199491ca343d787f36c0b0d456c9ecd8dc"}
Sep 09 19:03:55.809412 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.809164    2561 scope.go:117] "RemoveContainer" containerID="78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"
Sep 09 19:03:55.819113 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.819095    2561 scope.go:117] "RemoveContainer" containerID="78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"
Sep 09 19:03:55.819381 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:03:55.819363    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7\": container with ID starting with 78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7 not found: ID does not exist" containerID="78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"
Sep 09 19:03:55.819441 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.819402    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7"} err="failed to get container status \"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7\": rpc error: code = NotFound desc = could not find container \"78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7\": container with ID starting with 78f10125432faed8cc5a3dfc6b6b8469ebd84632069947f8f5929366ccd695f7 not found: ID does not exist"
Sep 09 19:03:55.831443 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.831418    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:03:55.836616 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:55.836595    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-03128a-645947d56f-5t684"]
Sep 09 19:03:56.609015 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:56.608982    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" path="/var/lib/kubelet/pods/7d89a790-6a6b-4f54-bfbf-9a4976362f8f/volumes"
Sep 09 19:03:58.303276 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:03:58.303238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:04:01.833916 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:01.833884    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:04:01.834328 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:01.834122    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy" containerID="cri-o://bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68" gracePeriod=30
Sep 09 19:04:02.214453 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214417    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"]
Sep 09 19:04:02.214844 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214830    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:02.214889 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214846    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:02.214889 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214856    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.214889 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214863    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214899    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" containerName="maas-api"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214905    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" containerName="maas-api"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214919    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214924    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.214994    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.215001    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.215010 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.215008    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:02.215240 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.215014    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d89a790-6a6b-4f54-bfbf-9a4976362f8f" containerName="maas-api"
Sep 09 19:04:02.215240 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.215021    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e484d5-487e-4170-b961-80d1d962ee84" containerName="istio-proxy"
Sep 09 19:04:02.219549 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.219531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:02.222230 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.222198    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 19:04:02.222408 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.222371    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 19:04:02.225410 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.225363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"]
Sep 09 19:04:02.361733 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.361685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng\" (UID: \"add153cc-4e9d-4ff8-9713-60659bff69e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:02.462875 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.462838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng\" (UID: \"add153cc-4e9d-4ff8-9713-60659bff69e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:02.463519 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.463495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng\" (UID: \"add153cc-4e9d-4ff8-9713-60659bff69e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:02.531863 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.531774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:02.805557 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.805511    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"]
Sep 09 19:04:02.808447 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:04:02.808377    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd153cc_4e9d_4ff8_9713_60659bff69e2.slice/crio-b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d WatchSource:0}: Error finding container b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d: Status 404 returned error can't find the container with id b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d
Sep 09 19:04:02.852702 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:02.852667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng" event={"ID":"add153cc-4e9d-4ff8-9713-60659bff69e2","Type":"ContainerStarted","Data":"b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d"}
Sep 09 19:04:03.860959 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:03.860920    2561 generic.go:356] "Generic (PLEG): container finished" podID="add153cc-4e9d-4ff8-9713-60659bff69e2" containerID="22a5934a6d0951b2beaed72dbba37c461fbee5442826e2adfa0b39c7122c0e9c" exitCode=0
Sep 09 19:04:03.861349 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:03.861008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng" event={"ID":"add153cc-4e9d-4ff8-9713-60659bff69e2","Type":"ContainerDied","Data":"22a5934a6d0951b2beaed72dbba37c461fbee5442826e2adfa0b39c7122c0e9c"}
Sep 09 19:04:05.015109 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.015075    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:05.089514 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.089476    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca\") pod \"add153cc-4e9d-4ff8-9713-60659bff69e2\" (UID: \"add153cc-4e9d-4ff8-9713-60659bff69e2\") "
Sep 09 19:04:05.089914 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.089889    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "add153cc-4e9d-4ff8-9713-60659bff69e2" (UID: "add153cc-4e9d-4ff8-9713-60659bff69e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:04:05.190566 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.190531    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/add153cc-4e9d-4ff8-9713-60659bff69e2-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:05.875119 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.875088    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"
Sep 09 19:04:05.875300 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.875085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng" event={"ID":"add153cc-4e9d-4ff8-9713-60659bff69e2","Type":"ContainerDied","Data":"b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d"}
Sep 09 19:04:05.875300 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:05.875224    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b45b0f4620c6f5e4be49e197971282b35e9669c4b12c58e6c0993ad39a4fa74d"
Sep 09 19:04:07.097034 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.096961    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:04:07.210306 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210529 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210529 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210418    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210529 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210529 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7llp\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210529 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210828 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210828 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210566    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210828 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210601    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data\") pod \"bdb4160f-24f5-4502-b236-a3e6cb600458\" (UID: \"bdb4160f-24f5-4502-b236-a3e6cb600458\") "
Sep 09 19:04:07.210828 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:07.211028 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.210858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:07.211079 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.211003    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:07.211079 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.211058    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.211171 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.211078    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.211171 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.211056    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:07.211171 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.211119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:04:07.213350 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.213325    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:04:07.213491 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.213350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:07.213491 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.213364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp" (OuterVolumeSpecName: "kube-api-access-r7llp") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "kube-api-access-r7llp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:07.213491 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.213442    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdb4160f-24f5-4502-b236-a3e6cb600458" (UID: "bdb4160f-24f5-4502-b236-a3e6cb600458"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:07.312225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312168    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312217    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdb4160f-24f5-4502-b236-a3e6cb600458-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312225 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312229    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312241    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312255    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7llp\" (UniqueName: \"kubernetes.io/projected/bdb4160f-24f5-4502-b236-a3e6cb600458-kube-api-access-r7llp\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312268    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.312533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.312281    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdb4160f-24f5-4502-b236-a3e6cb600458-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:07.890277 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.890239    2561 generic.go:356] "Generic (PLEG): container finished" podID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerID="bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68" exitCode=0
Sep 09 19:04:07.890508 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.890303    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"
Sep 09 19:04:07.890508 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.890328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerDied","Data":"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"}
Sep 09 19:04:07.890508 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.890412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv" event={"ID":"bdb4160f-24f5-4502-b236-a3e6cb600458","Type":"ContainerDied","Data":"7786e1d7e0283961b997ee302bae76ba4e6f13a2bce50d019d40d64c2d3de37a"}
Sep 09 19:04:07.890508 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.890439    2561 scope.go:117] "RemoveContainer" containerID="bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"
Sep 09 19:04:07.900384 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.900366    2561 scope.go:117] "RemoveContainer" containerID="90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"
Sep 09 19:04:07.909226 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.909205    2561 scope.go:117] "RemoveContainer" containerID="bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"
Sep 09 19:04:07.909656 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:07.909622    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68\": container with ID starting with bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68 not found: ID does not exist" containerID="bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"
Sep 09 19:04:07.909792 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.909667    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68"} err="failed to get container status \"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68\": rpc error: code = NotFound desc = could not find container \"bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68\": container with ID starting with bfe94fd7bbcd79819e31169ec274807e8ffad9aedda7c33cd6719c1bdd853a68 not found: ID does not exist"
Sep 09 19:04:07.909792 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.909692    2561 scope.go:117] "RemoveContainer" containerID="90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"
Sep 09 19:04:07.910088 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:07.910060    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397\": container with ID starting with 90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397 not found: ID does not exist" containerID="90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"
Sep 09 19:04:07.910182 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.910098    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397"} err="failed to get container status \"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397\": rpc error: code = NotFound desc = could not find container \"90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397\": container with ID starting with 90fb4a6e772032baaeb35e3d886c574d99e40532022982f53361620ec52ce397 not found: ID does not exist"
Sep 09 19:04:07.913115 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.913093    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:04:07.917238 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:07.917213    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-03128a-openshift-default-b7b9d5466-4hfvv"]
Sep 09 19:04:08.609195 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:08.609152    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" path="/var/lib/kubelet/pods/bdb4160f-24f5-4502-b236-a3e6cb600458/volumes"
Sep 09 19:04:12.862286 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:12.862238    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"]
Sep 09 19:04:12.865581 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:12.865558    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-282de3-4ltng"]
Sep 09 19:04:14.608866 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:14.608832    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add153cc-4e9d-4ff8-9713-60659bff69e2" path="/var/lib/kubelet/pods/add153cc-4e9d-4ff8-9713-60659bff69e2/volumes"
Sep 09 19:04:15.606240 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:15.606203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:04:19.515755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.515717    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 19:04:19.516179 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.515955    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy" containerID="cri-o://d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff" gracePeriod=30
Sep 09 19:04:19.955042 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955005    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"]
Sep 09 19:04:19.955429 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955414    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:19.955493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955431    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d83870-6140-4663-8ae0-d0d9edd4c4ef" containerName="istio-proxy"
Sep 09 19:04:19.955493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955440    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:04:19.955493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955447    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:04:19.955493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955463    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add153cc-4e9d-4ff8-9713-60659bff69e2" containerName="revoke-keys"
Sep 09 19:04:19.955493 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955468    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="add153cc-4e9d-4ff8-9713-60659bff69e2" containerName="revoke-keys"
Sep 09 19:04:19.955653 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955530    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="add153cc-4e9d-4ff8-9713-60659bff69e2" containerName="revoke-keys"
Sep 09 19:04:19.955653 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.955538    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:04:19.958592 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.958574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:19.961147 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.961103    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kfzt2\""
Sep 09 19:04:19.961280 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.961207    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 19:04:19.971044 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:19.971018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"]
Sep 09 19:04:20.141410 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.141363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd\" (UID: \"ed69d12d-14f2-4c72-b276-e9e56dad3dd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:20.242579 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.242475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd\" (UID: \"ed69d12d-14f2-4c72-b276-e9e56dad3dd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:20.243175 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.243153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd\" (UID: \"ed69d12d-14f2-4c72-b276-e9e56dad3dd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:20.269814 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.269783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:20.543774 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.543743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"]
Sep 09 19:04:20.546091 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:04:20.546062    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded69d12d_14f2_4c72_b276_e9e56dad3dd8.slice/crio-4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf WatchSource:0}: Error finding container 4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf: Status 404 returned error can't find the container with id 4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf
Sep 09 19:04:20.974717 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.974675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd" event={"ID":"ed69d12d-14f2-4c72-b276-e9e56dad3dd8","Type":"ContainerStarted","Data":"242267be352aff694055a97bd63f1b1caf53f02a1bd50f040b866b794cf5aa09"}
Sep 09 19:04:20.974905 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.974741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd" event={"ID":"ed69d12d-14f2-4c72-b276-e9e56dad3dd8","Type":"ContainerStarted","Data":"4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf"}
Sep 09 19:04:20.990914 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:20.990860    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd" podStartSLOduration=1.990846736 podStartE2EDuration="1.990846736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:04:20.988116272 +0000 UTC m=+1956.851053992" watchObservedRunningTime="2026-09-09 19:04:20.990846736 +0000 UTC m=+1956.853784488"
Sep 09 19:04:21.982916 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:21.982879    2561 generic.go:356] "Generic (PLEG): container finished" podID="ed69d12d-14f2-4c72-b276-e9e56dad3dd8" containerID="242267be352aff694055a97bd63f1b1caf53f02a1bd50f040b866b794cf5aa09" exitCode=0
Sep 09 19:04:21.983322 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:21.982963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd" event={"ID":"ed69d12d-14f2-4c72-b276-e9e56dad3dd8","Type":"ContainerDied","Data":"242267be352aff694055a97bd63f1b1caf53f02a1bd50f040b866b794cf5aa09"}
Sep 09 19:04:23.122104 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.122078    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:23.273333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.273240    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca\") pod \"ed69d12d-14f2-4c72-b276-e9e56dad3dd8\" (UID: \"ed69d12d-14f2-4c72-b276-e9e56dad3dd8\") "
Sep 09 19:04:23.273632 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.273608    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed69d12d-14f2-4c72-b276-e9e56dad3dd8" (UID: "ed69d12d-14f2-4c72-b276-e9e56dad3dd8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:04:23.374446 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.374383    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed69d12d-14f2-4c72-b276-e9e56dad3dd8-maas-api-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:23.995927 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.995892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd" event={"ID":"ed69d12d-14f2-4c72-b276-e9e56dad3dd8","Type":"ContainerDied","Data":"4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf"}
Sep 09 19:04:23.996105 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.995943    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4905923efbdea319319120b15a6a75d43e56d04af1cd08bd67ad437ba7fe86bf"
Sep 09 19:04:23.996105 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:23.995907    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"
Sep 09 19:04:24.768533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.768508    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 19:04:24.787837 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.787837 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787848    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787970    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.787990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trwdr\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788041    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788067    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo\") pod \"dafe9a2b-2637-4c0c-b894-86cab115a73e\" (UID: \"dafe9a2b-2637-4c0c-b894-86cab115a73e\") "
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788213    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788242    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788565    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafe9a2b-2637-4c0c-b894-86cab115a73e-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788586    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.788809 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.788668    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data" (OuterVolumeSpecName: "istio-data") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:24.790376 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.790352    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:24.790704 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.790662    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:24.790922 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.790865    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:04:24.791806 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.791775    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token" (OuterVolumeSpecName: "istio-token") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:24.792613 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.792591    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr" (OuterVolumeSpecName: "kube-api-access-trwdr") pod "dafe9a2b-2637-4c0c-b894-86cab115a73e" (UID: "dafe9a2b-2637-4c0c-b894-86cab115a73e"). InnerVolumeSpecName "kube-api-access-trwdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:24.889333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889300    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889328    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889338    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889346    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889670 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889355    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafe9a2b-2637-4c0c-b894-86cab115a73e-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889670 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889365    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:24.889670 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:24.889374    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trwdr\" (UniqueName: \"kubernetes.io/projected/dafe9a2b-2637-4c0c-b894-86cab115a73e-kube-api-access-trwdr\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:25.003570 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.003533    2561 generic.go:356] "Generic (PLEG): container finished" podID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerID="d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff" exitCode=0
Sep 09 19:04:25.003743 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.003613    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"
Sep 09 19:04:25.003743 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.003615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerDied","Data":"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"}
Sep 09 19:04:25.003818 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.003752    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb" event={"ID":"dafe9a2b-2637-4c0c-b894-86cab115a73e","Type":"ContainerDied","Data":"fde764e78274004c4b918965b9790752a7e296560f23da862be8556687309419"}
Sep 09 19:04:25.003818 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.003777    2561 scope.go:117] "RemoveContainer" containerID="d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"
Sep 09 19:04:25.015007 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.014989    2561 scope.go:117] "RemoveContainer" containerID="b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"
Sep 09 19:04:25.024307 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.024242    2561 scope.go:117] "RemoveContainer" containerID="d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"
Sep 09 19:04:25.024614 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:25.024591    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff\": container with ID starting with d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff not found: ID does not exist" containerID="d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"
Sep 09 19:04:25.024719 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.024627    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff"} err="failed to get container status \"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff\": rpc error: code = NotFound desc = could not find container \"d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff\": container with ID starting with d5635320cd3cd76d9dd891619afb5238c870ec6aa2d1791ad9d88e47460726ff not found: ID does not exist"
Sep 09 19:04:25.024719 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.024647    2561 scope.go:117] "RemoveContainer" containerID="b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"
Sep 09 19:04:25.024956 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:25.024929    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa\": container with ID starting with b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa not found: ID does not exist" containerID="b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"
Sep 09 19:04:25.025002 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.024967    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa"} err="failed to get container status \"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa\": rpc error: code = NotFound desc = could not find container \"b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa\": container with ID starting with b70b4afa8d47203cc393a26b11d3e5f484b034fe28ad892f8c6e8a7a5f6793aa not found: ID does not exist"
Sep 09 19:04:25.027223 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.027201    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 19:04:25.029559 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:25.029541    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-282de3-openshift-default-58f7bc6d64-zcgcb"]
Sep 09 19:04:26.609255 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:26.609214    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" path="/var/lib/kubelet/pods/dafe9a2b-2637-4c0c-b894-86cab115a73e/volumes"
Sep 09 19:04:30.589813 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:30.589770    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"]
Sep 09 19:04:30.593367 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:30.593327    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-0e012d-w82zd"]
Sep 09 19:04:30.609405 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:30.609370    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed69d12d-14f2-4c72-b276-e9e56dad3dd8" path="/var/lib/kubelet/pods/ed69d12d-14f2-4c72-b276-e9e56dad3dd8/volumes"
Sep 09 19:04:32.991702 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:32.991660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:04:37.486455 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:37.486368    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 19:04:37.486877 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:37.486597    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" containerID="cri-o://2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749" gracePeriod=30
Sep 09 19:04:41.394323 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:41.394277    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 19:04:41.394735 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:41.394354    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 19:04:42.107189 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.107141    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:04:42.752504 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.752429    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 19:04:42.855831 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855866    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855903    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855955    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.855990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856078    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data" (OuterVolumeSpecName: "istio-data") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcls6\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6\") pod \"d110e7ef-1e58-4e61-80e5-008bd0edc043\" (UID: \"d110e7ef-1e58-4e61-80e5-008bd0edc043\") "
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:42.856311 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856236    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:42.856665 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856473    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-data\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.856665 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856496    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.856665 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856508    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-credential-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.856665 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856573    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:42.856854 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.856733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:04:42.858351 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.858320    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:04:42.858539 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.858516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token" (OuterVolumeSpecName: "istio-token") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:42.858672 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.858598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 19:04:42.858672 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.858624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6" (OuterVolumeSpecName: "kube-api-access-xcls6") pod "d110e7ef-1e58-4e61-80e5-008bd0edc043" (UID: "d110e7ef-1e58-4e61-80e5-008bd0edc043"). InnerVolumeSpecName "kube-api-access-xcls6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:04:42.957372 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957326    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-podinfo\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.957372 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957368    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-token\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.957372 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957382    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-istio-envoy\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.957738 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957421    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d110e7ef-1e58-4e61-80e5-008bd0edc043-istiod-ca-cert\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.957738 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957435    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d110e7ef-1e58-4e61-80e5-008bd0edc043-workload-socket\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:42.957738 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:42.957448    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcls6\" (UniqueName: \"kubernetes.io/projected/d110e7ef-1e58-4e61-80e5-008bd0edc043-kube-api-access-xcls6\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:04:43.120620 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.120521    2561 generic.go:356] "Generic (PLEG): container finished" podID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerID="2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749" exitCode=0
Sep 09 19:04:43.120620 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.120572    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"
Sep 09 19:04:43.120620 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.120603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerDied","Data":"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"}
Sep 09 19:04:43.120866 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.120657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss" event={"ID":"d110e7ef-1e58-4e61-80e5-008bd0edc043","Type":"ContainerDied","Data":"c1645a4274571b70aae3a57d4393f7bcb2f5555a2dd5ce63711e234bb9203394"}
Sep 09 19:04:43.120866 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.120682    2561 scope.go:117] "RemoveContainer" containerID="2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"
Sep 09 19:04:43.134805 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.131748    2561 scope.go:117] "RemoveContainer" containerID="5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"
Sep 09 19:04:43.145614 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.145589    2561 scope.go:117] "RemoveContainer" containerID="2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"
Sep 09 19:04:43.145966 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:43.145938    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749\": container with ID starting with 2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749 not found: ID does not exist" containerID="2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"
Sep 09 19:04:43.146052 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.145981    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749"} err="failed to get container status \"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749\": rpc error: code = NotFound desc = could not find container \"2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749\": container with ID starting with 2269168e7dfc751ba90df373ba17da7979967bd405fe2e8db010ac66b7301749 not found: ID does not exist"
Sep 09 19:04:43.146052 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.146008    2561 scope.go:117] "RemoveContainer" containerID="5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"
Sep 09 19:04:43.146334 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:04:43.146310    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d\": container with ID starting with 5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d not found: ID does not exist" containerID="5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"
Sep 09 19:04:43.146416 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.146344    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d"} err="failed to get container status \"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d\": rpc error: code = NotFound desc = could not find container \"5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d\": container with ID starting with 5d318d03f2ff9eff1df7407a00c8908c501c97ce34a27fb0e46eb3b8e5b97b4d not found: ID does not exist"
Sep 09 19:04:43.157140 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.157104    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 19:04:43.161050 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:43.161024    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-0e012d-openshift-default-7584899b6-hk9ss"]
Sep 09 19:04:44.609323 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:04:44.609289    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" path="/var/lib/kubelet/pods/d110e7ef-1e58-4e61-80e5-008bd0edc043/volumes"
Sep 09 19:05:45.103634 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:05:45.103601    2561 scope.go:117] "RemoveContainer" containerID="cd475700a16bb4618f2263eec70ca8142b7e8df01ba5a86c4bb89c7b5e9a33b0"
Sep 09 19:06:02.500209 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:02.500167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:06:28.102106 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:28.102022    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:06:36.006418 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:36.006366    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:06:44.104155 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:44.104115    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:06:44.771866 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:44.771839    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 19:06:44.780255 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:44.780234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-74fsn_ccdcd749-f568-4d23-ba61-03891432f2f5/ovn-acl-logging/0.log"
Sep 09 19:06:45.125051 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:45.124964    2561 scope.go:117] "RemoveContainer" containerID="c99512956c7baea37fe7fdde8e80aacf702e41beb25e180c2d2ea74f625b7708"
Sep 09 19:06:45.133766 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:06:45.133747    2561 scope.go:117] "RemoveContainer" containerID="df0a123a76ab07fd3d7a8d233d0e2c39e2d3cdf79b2f93c3e9e5ea10c9bbccef"
Sep 09 19:07:00.096494 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:00.096451    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:07:06.501970 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:06.501929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:07:09.846176 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:09.846143    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 19:07:09.846659 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:09.846334    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" podUID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" containerName="manager" containerID="cri-o://9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b" gracePeriod=10
Sep 09 19:07:10.295727 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.295701    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 19:07:10.370445 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.370412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume\") pod \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") "
Sep 09 19:07:10.370610 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.370500    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jvkq\" (UniqueName: \"kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq\") pod \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\" (UID: \"b3438ed1-e15e-493a-bc6c-bee4ead044c5\") "
Sep 09 19:07:10.370803 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.370766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b3438ed1-e15e-493a-bc6c-bee4ead044c5" (UID: "b3438ed1-e15e-493a-bc6c-bee4ead044c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 19:07:10.372556 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.372528    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq" (OuterVolumeSpecName: "kube-api-access-7jvkq") pod "b3438ed1-e15e-493a-bc6c-bee4ead044c5" (UID: "b3438ed1-e15e-493a-bc6c-bee4ead044c5"). InnerVolumeSpecName "kube-api-access-7jvkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:07:10.471337 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.471247    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3438ed1-e15e-493a-bc6c-bee4ead044c5-extensions-socket-volume\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:07:10.471337 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.471283    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jvkq\" (UniqueName: \"kubernetes.io/projected/b3438ed1-e15e-493a-bc6c-bee4ead044c5-kube-api-access-7jvkq\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:07:10.981281 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.981245    2561 generic.go:356] "Generic (PLEG): container finished" podID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" containerID="9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b" exitCode=0
Sep 09 19:07:10.981765 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.981284    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"
Sep 09 19:07:10.981765 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.981332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" event={"ID":"b3438ed1-e15e-493a-bc6c-bee4ead044c5","Type":"ContainerDied","Data":"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"}
Sep 09 19:07:10.981765 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.981381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx" event={"ID":"b3438ed1-e15e-493a-bc6c-bee4ead044c5","Type":"ContainerDied","Data":"626c8fccb5cbc061c28126bffdf597bea7bb632a52118b7ad6cf4d7aadb5c76c"}
Sep 09 19:07:10.981765 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.981417    2561 scope.go:117] "RemoveContainer" containerID="9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"
Sep 09 19:07:10.991415 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.991374    2561 scope.go:117] "RemoveContainer" containerID="9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"
Sep 09 19:07:10.991685 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:07:10.991661    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b\": container with ID starting with 9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b not found: ID does not exist" containerID="9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"
Sep 09 19:07:10.991728 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.991697    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b"} err="failed to get container status \"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b\": rpc error: code = NotFound desc = could not find container \"9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b\": container with ID starting with 9d5e5f2860311ae0c9c981fb9bad03ee5bbbcb16857490852715099177deba1b not found: ID does not exist"
Sep 09 19:07:10.999849 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:10.999824    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 19:07:11.007414 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:11.005209    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-x6pfx"]
Sep 09 19:07:12.608647 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:07:12.608609    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" path="/var/lib/kubelet/pods/b3438ed1-e15e-493a-bc6c-bee4ead044c5/volumes"
Sep 09 19:08:10.565451 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565387    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"]
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565781    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69d12d-14f2-4c72-b276-e9e56dad3dd8" containerName="revoke-keys"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565794    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69d12d-14f2-4c72-b276-e9e56dad3dd8" containerName="revoke-keys"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565804    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565809    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565817    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" containerName="manager"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565822    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" containerName="manager"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565835    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565840    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565850    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565855    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565868    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565874    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565880    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:08:10.565894 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565885    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:08:10.566326 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565943    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3438ed1-e15e-493a-bc6c-bee4ead044c5" containerName="manager"
Sep 09 19:08:10.566326 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565951    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb4160f-24f5-4502-b236-a3e6cb600458" containerName="istio-proxy"
Sep 09 19:08:10.566326 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565958    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69d12d-14f2-4c72-b276-e9e56dad3dd8" containerName="revoke-keys"
Sep 09 19:08:10.566326 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565965    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:08:10.566326 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.565971    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:08:10.568873 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.568856    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.571385 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.571366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-c2wm6\""
Sep 09 19:08:10.582299 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.582271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"]
Sep 09 19:08:10.712533 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.712496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/99d9b92d-b671-450b-829f-213a5bf1d917-kube-api-access-m86d2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.712702 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.712561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99d9b92d-b671-450b-829f-213a5bf1d917-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.813019 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.812986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/99d9b92d-b671-450b-829f-213a5bf1d917-kube-api-access-m86d2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.813019 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.813025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99d9b92d-b671-450b-829f-213a5bf1d917-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.813442 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.813420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99d9b92d-b671-450b-829f-213a5bf1d917-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.821971 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.821907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86d2\" (UniqueName: \"kubernetes.io/projected/99d9b92d-b671-450b-829f-213a5bf1d917-kube-api-access-m86d2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7xl66\" (UID: \"99d9b92d-b671-450b-829f-213a5bf1d917\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:10.879564 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:10.879519    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:11.163703 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:11.163675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"]
Sep 09 19:08:11.165308 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:08:11.165282    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d9b92d_b671_450b_829f_213a5bf1d917.slice/crio-0b3255eae2d54970e2855758d61be10e9b8d6226c95c6a353e93b74f0461a05f WatchSource:0}: Error finding container 0b3255eae2d54970e2855758d61be10e9b8d6226c95c6a353e93b74f0461a05f: Status 404 returned error can't find the container with id 0b3255eae2d54970e2855758d61be10e9b8d6226c95c6a353e93b74f0461a05f
Sep 09 19:08:11.314821 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:11.314776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66" event={"ID":"99d9b92d-b671-450b-829f-213a5bf1d917","Type":"ContainerStarted","Data":"dfe53e7bcb2d02246793fc2adf592ba4b2fe940b71efefe632a24198a694209e"}
Sep 09 19:08:11.315012 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:11.314850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:11.315012 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:11.314870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66" event={"ID":"99d9b92d-b671-450b-829f-213a5bf1d917","Type":"ContainerStarted","Data":"0b3255eae2d54970e2855758d61be10e9b8d6226c95c6a353e93b74f0461a05f"}
Sep 09 19:08:11.338662 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:11.338608    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66" podStartSLOduration=1.3385914589999999 podStartE2EDuration="1.338591459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:08:11.33530166 +0000 UTC m=+2187.198239357" watchObservedRunningTime="2026-09-09 19:08:11.338591459 +0000 UTC m=+2187.201529156"
Sep 09 19:08:22.323269 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:22.323236    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7xl66"
Sep 09 19:08:34.895001 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:34.894963    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:08:41.409628 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:41.409590    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:08:49.304116 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:49.304072    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:08:55.202723 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:08:55.202681    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:13.309617 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:13.309537    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:22.911275 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:22.911230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:29.712541 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:29.712503    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:30.082099 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.082012    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:30.082487 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.082474    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d110e7ef-1e58-4e61-80e5-008bd0edc043" containerName="istio-proxy"
Sep 09 19:09:30.082542 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.082493    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafe9a2b-2637-4c0c-b894-86cab115a73e" containerName="istio-proxy"
Sep 09 19:09:30.085605 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.085589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.088897 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.088865    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 19:09:30.088897 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.088867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wsrn9\""
Sep 09 19:09:30.089101 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.088906    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 19:09:30.089101 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.088909    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 19:09:30.089101 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.088869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 19:09:30.098754 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.098730    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:30.102556 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.102530    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"]
Sep 09 19:09:30.106214 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.106197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.123102 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.123025    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"]
Sep 09 19:09:30.225100 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-metrics-certs\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.225100 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.225306 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.225306 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvnmx\" (UniqueName: \"kubernetes.io/projected/4019b862-d0df-4113-92fc-413cbd05299e-kube-api-access-xvnmx\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.225382 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-maas-api-tls\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.225382 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.225382 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4019b862-d0df-4113-92fc-413cbd05299e-openshift-service-ca\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.225382 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.225379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rmnj\" (UniqueName: \"kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.326905 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.326865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvnmx\" (UniqueName: \"kubernetes.io/projected/4019b862-d0df-4113-92fc-413cbd05299e-kube-api-access-xvnmx\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.326932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-maas-api-tls\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.326968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.327000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4019b862-d0df-4113-92fc-413cbd05299e-openshift-service-ca\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.327146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rmnj\" (UniqueName: \"kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.327197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-metrics-certs\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.327224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.327755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.327278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.328877 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.328192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4019b862-d0df-4113-92fc-413cbd05299e-openshift-service-ca\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.328877 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.328217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.330179 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.330155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.330566 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.330542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-maas-api-tls\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.330675 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.330549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4019b862-d0df-4113-92fc-413cbd05299e-metrics-certs\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.330779 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.330755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.335963 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.335899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvnmx\" (UniqueName: \"kubernetes.io/projected/4019b862-d0df-4113-92fc-413cbd05299e-kube-api-access-xvnmx\") pod \"maas-api-6d75774dd5-fqn5z\" (UID: \"4019b862-d0df-4113-92fc-413cbd05299e\") " pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.336473 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.336451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rmnj\" (UniqueName: \"kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj\") pod \"maas-api-5cb87fb765-ljh4v\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") " pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.396519 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.396484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:30.415235 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.415204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:30.673919 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.673893    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:30.675235 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:09:30.675209    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce183255_fb06_45d3_b9c0_0b93a8a1302b.slice/crio-d24aae5fc936986351e75c195170fdaf90541ba8de69e23b4e3278e1304089f8 WatchSource:0}: Error finding container d24aae5fc936986351e75c195170fdaf90541ba8de69e23b4e3278e1304089f8: Status 404 returned error can't find the container with id d24aae5fc936986351e75c195170fdaf90541ba8de69e23b4e3278e1304089f8
Sep 09 19:09:30.676540 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.676523    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 19:09:30.710067 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.710045    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"]
Sep 09 19:09:30.711651 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:09:30.711622    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4019b862_d0df_4113_92fc_413cbd05299e.slice/crio-56de9807d3d7a5abcb316feb7090899e83ef5164c6a67ced825bfba8fee26974 WatchSource:0}: Error finding container 56de9807d3d7a5abcb316feb7090899e83ef5164c6a67ced825bfba8fee26974: Status 404 returned error can't find the container with id 56de9807d3d7a5abcb316feb7090899e83ef5164c6a67ced825bfba8fee26974
Sep 09 19:09:30.756449 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.756419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z" event={"ID":"4019b862-d0df-4113-92fc-413cbd05299e","Type":"ContainerStarted","Data":"56de9807d3d7a5abcb316feb7090899e83ef5164c6a67ced825bfba8fee26974"}
Sep 09 19:09:30.757652 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:30.757633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" event={"ID":"ce183255-fb06-45d3-b9c0-0b93a8a1302b","Type":"ContainerStarted","Data":"d24aae5fc936986351e75c195170fdaf90541ba8de69e23b4e3278e1304089f8"}
Sep 09 19:09:31.765241 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.765196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z" event={"ID":"4019b862-d0df-4113-92fc-413cbd05299e","Type":"ContainerStarted","Data":"8bcf54f30f70451d329109798502c53281def8e9dd7ee4790de4ff2959648392"}
Sep 09 19:09:31.765740 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.765274    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:31.766849 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.766827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" event={"ID":"ce183255-fb06-45d3-b9c0-0b93a8a1302b","Type":"ContainerStarted","Data":"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"}
Sep 09 19:09:31.766927 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.766903    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:31.798718 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.798671    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z" podStartSLOduration=1.236061749 podStartE2EDuration="1.798656308s" totalImagesPullingTime="562.594559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:09:31.795493474 +0000 UTC m=+2267.658431264" watchObservedRunningTime="2026-09-09 19:09:31.798656308 +0000 UTC m=+2267.661594006"
Sep 09 19:09:31.819144 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:31.819097    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" podStartSLOduration=1.3332611349999999 podStartE2EDuration="1.819083977s" totalImagesPullingTime="485.822842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:09:31.816784558 +0000 UTC m=+2267.679722285" watchObservedRunningTime="2026-09-09 19:09:31.819083977 +0000 UTC m=+2267.682021675"
Sep 09 19:09:37.617206 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:37.617157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:37.777589 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:37.777556    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:37.777911 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:37.777891    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d75774dd5-fqn5z"
Sep 09 19:09:37.849431 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:37.849379    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:37.849857 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:37.849816    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" podUID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" containerName="maas-api" containerID="cri-o://0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9" gracePeriod=30
Sep 09 19:09:38.093476 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.093452    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:38.205753 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.205714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca\") pod \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") "
Sep 09 19:09:38.205753 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.205754    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs\") pod \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") "
Sep 09 19:09:38.206015 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.205860    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls\") pod \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") "
Sep 09 19:09:38.206015 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.205892    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rmnj\" (UniqueName: \"kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj\") pod \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\" (UID: \"ce183255-fb06-45d3-b9c0-0b93a8a1302b\") "
Sep 09 19:09:38.206213 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.206182    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce183255-fb06-45d3-b9c0-0b93a8a1302b" (UID: "ce183255-fb06-45d3-b9c0-0b93a8a1302b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 19:09:38.208022 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.207989    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce183255-fb06-45d3-b9c0-0b93a8a1302b" (UID: "ce183255-fb06-45d3-b9c0-0b93a8a1302b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 19:09:38.208164 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.208038    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce183255-fb06-45d3-b9c0-0b93a8a1302b" (UID: "ce183255-fb06-45d3-b9c0-0b93a8a1302b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 19:09:38.208164 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.208067    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj" (OuterVolumeSpecName: "kube-api-access-6rmnj") pod "ce183255-fb06-45d3-b9c0-0b93a8a1302b" (UID: "ce183255-fb06-45d3-b9c0-0b93a8a1302b"). InnerVolumeSpecName "kube-api-access-6rmnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 19:09:38.307552 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.307511    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-maas-api-tls\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:09:38.307552 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.307545    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rmnj\" (UniqueName: \"kubernetes.io/projected/ce183255-fb06-45d3-b9c0-0b93a8a1302b-kube-api-access-6rmnj\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:09:38.307552 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.307556    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce183255-fb06-45d3-b9c0-0b93a8a1302b-openshift-service-ca\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:09:38.307797 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.307564    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce183255-fb06-45d3-b9c0-0b93a8a1302b-metrics-certs\") on node \"ip-10-0-135-73.ec2.internal\" DevicePath \"\""
Sep 09 19:09:38.815185 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.815151    2561 generic.go:356] "Generic (PLEG): container finished" podID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" containerID="0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9" exitCode=0
Sep 09 19:09:38.815684 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.815203    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"
Sep 09 19:09:38.815684 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.815243    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" event={"ID":"ce183255-fb06-45d3-b9c0-0b93a8a1302b","Type":"ContainerDied","Data":"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"}
Sep 09 19:09:38.815684 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.815298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v" event={"ID":"ce183255-fb06-45d3-b9c0-0b93a8a1302b","Type":"ContainerDied","Data":"d24aae5fc936986351e75c195170fdaf90541ba8de69e23b4e3278e1304089f8"}
Sep 09 19:09:38.815684 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.815320    2561 scope.go:117] "RemoveContainer" containerID="0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"
Sep 09 19:09:38.824317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.824299    2561 scope.go:117] "RemoveContainer" containerID="0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"
Sep 09 19:09:38.824598 ip-10-0-135-73 kubenswrapper[2561]: E0909 19:09:38.824580    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9\": container with ID starting with 0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9 not found: ID does not exist" containerID="0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"
Sep 09 19:09:38.824658 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.824608    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9"} err="failed to get container status \"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9\": rpc error: code = NotFound desc = could not find container \"0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9\": container with ID starting with 0fc206adf15cffa214c4cc14fdb4a35c91d4cbed8954f385be29eab5639156e9 not found: ID does not exist"
Sep 09 19:09:38.831753 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.831724    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:38.834563 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:38.834542    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb87fb765-ljh4v"]
Sep 09 19:09:40.608937 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:40.608903    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" path="/var/lib/kubelet/pods/ce183255-fb06-45d3-b9c0-0b93a8a1302b/volumes"
Sep 09 19:09:44.212853 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:44.212811    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:50.209958 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:50.209920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:09:57.320125 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:09:57.320082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qqwkc"]
Sep 09 19:10:06.281923 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:06.281894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rklcm_18ad24ff-42f4-43fd-b655-ea605601dbad/server/0.log"
Sep 09 19:10:06.820047 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:06.820014    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f66f47469-qxf22_ca2d216d-6a4a-4b31-937f-dcd3b137c55e/copy-manifests/0.log"
Sep 09 19:10:06.827930 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:06.827904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f66f47469-qxf22_ca2d216d-6a4a-4b31-937f-dcd3b137c55e/manager/0.log"
Sep 09 19:10:07.309833 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:07.309802    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d75774dd5-fqn5z_4019b862-d0df-4113-92fc-413cbd05299e/maas-api/0.log"
Sep 09 19:10:07.426657 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:07.426627    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816340-7j88w_2504369c-4fb2-4b77-b849-4f5b9e0f26de/cleanup/0.log"
Sep 09 19:10:08.634684 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:08.634652    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-sj85v_bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba/manager/0.log"
Sep 09 19:10:08.752962 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:08.752934    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-sbh92_e9daecef-1b3d-45f1-bfed-d4f958f20223/kuadrant-console-plugin/0.log"
Sep 09 19:10:08.880822 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:08.880785    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7xl66_99d9b92d-b671-450b-829f-213a5bf1d917/manager/0.log"
Sep 09 19:10:09.005661 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:09.005624    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qqwkc_986d7b0a-ef58-4a78-bb8e-fd18db49332c/limitador/0.log"
Sep 09 19:10:09.504376 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:09.504349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9_6f86deb5-0b9a-442b-a6ee-33a56b02008c/istio-proxy/0.log"
Sep 09 19:10:10.011384 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:10.011353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/1.log"
Sep 09 19:10:10.421204 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:10.421175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d4ff4d8d-hs5d8_8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622/router/0.log"
Sep 09 19:10:11.137905 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:11.137875    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nkr5t_5b275997-1668-40fc-b90e-f03b1595aafd/main/0.log"
Sep 09 19:10:17.308337 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.308301    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dz2cr/must-gather-5qs6m"]
Sep 09 19:10:17.308755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.308732    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" containerName="maas-api"
Sep 09 19:10:17.308755 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.308745    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" containerName="maas-api"
Sep 09 19:10:17.308839 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.308808    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce183255-fb06-45d3-b9c0-0b93a8a1302b" containerName="maas-api"
Sep 09 19:10:17.312361 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.312340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.314967 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.314946    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dz2cr\"/\"kube-root-ca.crt\""
Sep 09 19:10:17.315114 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.315097    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dz2cr\"/\"openshift-service-ca.crt\""
Sep 09 19:10:17.315170 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.315123    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dz2cr\"/\"default-dockercfg-dnjv8\""
Sep 09 19:10:17.347400 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.347368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dz2cr/must-gather-5qs6m"]
Sep 09 19:10:17.461299 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.461260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qccl\" (UniqueName: \"kubernetes.io/projected/fed65fac-62e8-4200-ba8e-88728578a3dd-kube-api-access-8qccl\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.461299 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.461305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fed65fac-62e8-4200-ba8e-88728578a3dd-must-gather-output\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.562218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.562117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qccl\" (UniqueName: \"kubernetes.io/projected/fed65fac-62e8-4200-ba8e-88728578a3dd-kube-api-access-8qccl\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.562218 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.562165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fed65fac-62e8-4200-ba8e-88728578a3dd-must-gather-output\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.562577 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.562556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fed65fac-62e8-4200-ba8e-88728578a3dd-must-gather-output\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.579861 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.579827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qccl\" (UniqueName: \"kubernetes.io/projected/fed65fac-62e8-4200-ba8e-88728578a3dd-kube-api-access-8qccl\") pod \"must-gather-5qs6m\" (UID: \"fed65fac-62e8-4200-ba8e-88728578a3dd\") " pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.620937 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.620907    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dz2cr/must-gather-5qs6m"
Sep 09 19:10:17.895091 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:17.895060    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dz2cr/must-gather-5qs6m"]
Sep 09 19:10:17.897042 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:10:17.897014    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfed65fac_62e8_4200_ba8e_88728578a3dd.slice/crio-f843916fd3562677f48a87f523578758ec5669ac3fd888bdca425214f8d7c418 WatchSource:0}: Error finding container f843916fd3562677f48a87f523578758ec5669ac3fd888bdca425214f8d7c418: Status 404 returned error can't find the container with id f843916fd3562677f48a87f523578758ec5669ac3fd888bdca425214f8d7c418
Sep 09 19:10:18.037747 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:18.037709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dz2cr/must-gather-5qs6m" event={"ID":"fed65fac-62e8-4200-ba8e-88728578a3dd","Type":"ContainerStarted","Data":"f843916fd3562677f48a87f523578758ec5669ac3fd888bdca425214f8d7c418"}
Sep 09 19:10:23.074134 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:23.074092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dz2cr/must-gather-5qs6m" event={"ID":"fed65fac-62e8-4200-ba8e-88728578a3dd","Type":"ContainerStarted","Data":"b960435fc9c75d3138081f62c115513505f10d78f831e13132efcf49016d9916"}
Sep 09 19:10:23.074741 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:23.074705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dz2cr/must-gather-5qs6m" event={"ID":"fed65fac-62e8-4200-ba8e-88728578a3dd","Type":"ContainerStarted","Data":"4d4cd506e36f03238bf8c26b43071dfdf7428815234629c1e3f346e88dea41cf"}
Sep 09 19:10:23.095145 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:23.095084    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dz2cr/must-gather-5qs6m" podStartSLOduration=1.716617311 podStartE2EDuration="6.095058069s" totalImagesPullingTime="4.378440758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:10:23.092605409 +0000 UTC m=+2318.955543108" watchObservedRunningTime="2026-09-09 19:10:23.095058069 +0000 UTC m=+2318.957995768"
Sep 09 19:10:24.203581 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:24.203546    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ckq2d_0b82c788-6c20-462a-a520-e582445f0279/global-pull-secret-syncer/0.log"
Sep 09 19:10:24.375555 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:24.375522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s4xvv_0b935d99-19cd-40df-8f84-7cfe74c2be6f/konnectivity-agent/0.log"
Sep 09 19:10:24.476980 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:24.476891    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-73.ec2.internal_0bc8c9cd701097f2fb518447aa67110d/haproxy/0.log"
Sep 09 19:10:29.032654 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:29.032626    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-sj85v_bcd7eb8c-83c6-4ba4-aef1-19bceaf209ba/manager/0.log"
Sep 09 19:10:29.066907 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:29.066824    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-sbh92_e9daecef-1b3d-45f1-bfed-d4f958f20223/kuadrant-console-plugin/0.log"
Sep 09 19:10:29.151199 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:29.150629    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7xl66_99d9b92d-b671-450b-829f-213a5bf1d917/manager/0.log"
Sep 09 19:10:29.176415 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:29.175976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qqwkc_986d7b0a-ef58-4a78-bb8e-fd18db49332c/limitador/0.log"
Sep 09 19:10:30.909766 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:30.909732    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-state-metrics/0.log"
Sep 09 19:10:30.939059 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:30.939025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-rbac-proxy-main/0.log"
Sep 09 19:10:30.975409 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:30.975360    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ps5zx_afea8ff0-b4d4-4ad3-b128-f0d56c36090a/kube-rbac-proxy-self/0.log"
Sep 09 19:10:31.044540 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.044504    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-trwk7_79ac1a8c-a3e2-437a-bec2-52d9cec59c2c/monitoring-plugin/0.log"
Sep 09 19:10:31.193055 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.192973    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/node-exporter/0.log"
Sep 09 19:10:31.225384 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.225351    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/kube-rbac-proxy/0.log"
Sep 09 19:10:31.252413 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.252364    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcpwq_c5b1e48a-f3c7-4cf0-a52a-0ded72ff77c8/init-textfile/0.log"
Sep 09 19:10:31.805596 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.805501    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fbh2c_e3e43b02-2817-46fe-8161-654073192a58/prometheus-operator/0.log"
Sep 09 19:10:31.858689 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:31.858655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fbh2c_e3e43b02-2817-46fe-8161-654073192a58/kube-rbac-proxy/0.log"
Sep 09 19:10:32.055713 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.055615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/thanos-query/0.log"
Sep 09 19:10:32.088456 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.088273    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-web/0.log"
Sep 09 19:10:32.130980 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.130950    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy/0.log"
Sep 09 19:10:32.195333 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.195299    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/prom-label-proxy/0.log"
Sep 09 19:10:32.254026 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.253998    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-rules/0.log"
Sep 09 19:10:32.289567 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:32.289536    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8f5f595c4-dzxvd_ebb9d02b-2109-42c5-b6e0-f300ff5d65cf/kube-rbac-proxy-metrics/0.log"
Sep 09 19:10:33.684476 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:33.684444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-mhbxb_01e6558b-f477-40e3-8043-09390d741210/networking-console-plugin/0.log"
Sep 09 19:10:34.161612 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.161575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"]
Sep 09 19:10:34.185469 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.185353    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"]
Sep 09 19:10:34.185670 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.185511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.243005 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.242967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-sys\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.243005 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.243010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr87j\" (UniqueName: \"kubernetes.io/projected/e7e684d7-1428-426f-8191-06558d5fa94f-kube-api-access-xr87j\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.243259 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.243047    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-lib-modules\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.243259 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.243128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-proc\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.243259 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.243220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-podres\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.343939 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.343896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-podres\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344139 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.343993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-sys\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344139 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr87j\" (UniqueName: \"kubernetes.io/projected/e7e684d7-1428-426f-8191-06558d5fa94f-kube-api-access-xr87j\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344139 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-lib-modules\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344139 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-proc\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344139 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-sys\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344409 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-proc\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344409 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-podres\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.344409 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.344303    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7e684d7-1428-426f-8191-06558d5fa94f-lib-modules\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.355557 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.355526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr87j\" (UniqueName: \"kubernetes.io/projected/e7e684d7-1428-426f-8191-06558d5fa94f-kube-api-access-xr87j\") pod \"perf-node-gather-daemonset-v4n6n\" (UID: \"e7e684d7-1428-426f-8191-06558d5fa94f\") " pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.500111 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.500023    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:34.828899 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:34.828867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"]
Sep 09 19:10:34.830191 ip-10-0-135-73 kubenswrapper[2561]: W0909 19:10:34.829579    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7e684d7_1428_426f_8191_06558d5fa94f.slice/crio-bdfc35dbf16bf361712c14d3765b808f1db6fe6d079c48d9fd92d9d6f15893f4 WatchSource:0}: Error finding container bdfc35dbf16bf361712c14d3765b808f1db6fe6d079c48d9fd92d9d6f15893f4: Status 404 returned error can't find the container with id bdfc35dbf16bf361712c14d3765b808f1db6fe6d079c48d9fd92d9d6f15893f4
Sep 09 19:10:35.081292 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.081135    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56c6fc8bc6-xn79t_33f5ff80-812d-4ed9-8db9-e5e1921fe206/console/0.log"
Sep 09 19:10:35.138317 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.138279    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-2c2qw_9e508a44-1510-4022-9712-11890a199862/download-server/0.log"
Sep 09 19:10:35.197858 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.197809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n" event={"ID":"e7e684d7-1428-426f-8191-06558d5fa94f","Type":"ContainerStarted","Data":"d6fb700ab524cdce363eeb818d4c11db9cf1ccd2c9ffcb34ee204104b54803a8"}
Sep 09 19:10:35.198070 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.197887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n" event={"ID":"e7e684d7-1428-426f-8191-06558d5fa94f","Type":"ContainerStarted","Data":"bdfc35dbf16bf361712c14d3765b808f1db6fe6d079c48d9fd92d9d6f15893f4"}
Sep 09 19:10:35.198268 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.198209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:35.218092 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:35.218026    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n" podStartSLOduration=1.218004355 podStartE2EDuration="1.218004355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:10:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:10:35.216640459 +0000 UTC m=+2331.079578171" watchObservedRunningTime="2026-09-09 19:10:35.218004355 +0000 UTC m=+2331.080942054"
Sep 09 19:10:36.943389 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:36.943308    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvm87_94a3c247-eaee-4be8-994b-d9b4204eaca5/dns/0.log"
Sep 09 19:10:37.012606 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:37.012576    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvm87_94a3c247-eaee-4be8-994b-d9b4204eaca5/kube-rbac-proxy/0.log"
Sep 09 19:10:37.405770 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:37.405738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-td2tq_d02deed6-0ece-448a-af83-5a70d6cc352a/dns-node-resolver/0.log"
Sep 09 19:10:38.039111 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:38.039078    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b9jkw_51faa0c6-1dbd-4781-8d94-b76416cac7b6/node-ca/0.log"
Sep 09 19:10:39.063312 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:39.063282    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9_6f86deb5-0b9a-442b-a6ee-33a56b02008c/istio-proxy/0.log"
Sep 09 19:10:39.587652 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:39.587615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/0.log"
Sep 09 19:10:39.597211 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:39.597183    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/1.log"
Sep 09 19:10:39.730025 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:39.729996    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d4ff4d8d-hs5d8_8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622/router/0.log"
Sep 09 19:10:40.706501 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:40.706473    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rwtwz_92f504bd-303b-429e-b0fc-497f42a5d68d/serve-healthcheck-canary/0.log"
Sep 09 19:10:41.220708 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:41.220678    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dz2cr/perf-node-gather-daemonset-v4n6n"
Sep 09 19:10:41.349914 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:41.349883    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2f2cq_324c9404-a8b5-4765-8c00-0d764fa73acc/kube-rbac-proxy/0.log"
Sep 09 19:10:41.386962 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:41.386933    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2f2cq_324c9404-a8b5-4765-8c00-0d764fa73acc/exporter/0.log"
Sep 09 19:10:41.429216 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:41.429181    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2f2cq_324c9404-a8b5-4765-8c00-0d764fa73acc/extractor/0.log"
Sep 09 19:10:44.446827 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:44.446790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9_6f86deb5-0b9a-442b-a6ee-33a56b02008c/istio-proxy/0.log"
Sep 09 19:10:44.665985 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:44.665959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rklcm_18ad24ff-42f4-43fd-b655-ea605601dbad/server/0.log"
Sep 09 19:10:45.028726 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.028689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/0.log"
Sep 09 19:10:45.036527 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.036504    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/1.log"
Sep 09 19:10:45.142647 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.142615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d4ff4d8d-hs5d8_8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622/router/0.log"
Sep 09 19:10:45.211963 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.211932    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f66f47469-qxf22_ca2d216d-6a4a-4b31-937f-dcd3b137c55e/manager/0.log"
Sep 09 19:10:45.214121 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.214086    2561 scope.go:117] "RemoveContainer" containerID="242267be352aff694055a97bd63f1b1caf53f02a1bd50f040b866b794cf5aa09"
Sep 09 19:10:45.229383 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.229358    2561 scope.go:117] "RemoveContainer" containerID="22a5934a6d0951b2beaed72dbba37c461fbee5442826e2adfa0b39c7122c0e9c"
Sep 09 19:10:45.237236 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:45.237215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f66f47469-qxf22_ca2d216d-6a4a-4b31-937f-dcd3b137c55e/copy-manifests/0.log"
Sep 09 19:10:46.660355 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:46.660331    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-96799d79b-frdn7_8e0a2f63-a86b-4860-ad7e-f6f1ee2da823/manager/0.log"
Sep 09 19:10:46.809414 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:46.809368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-k8gn9_6f86deb5-0b9a-442b-a6ee-33a56b02008c/istio-proxy/0.log"
Sep 09 19:10:47.412198 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:47.412157    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/0.log"
Sep 09 19:10:47.421546 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:47.421518    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-985bs_61be4672-4f0f-44ef-999b-6464adca0f00/istio-proxy/1.log"
Sep 09 19:10:47.509036 ip-10-0-135-73 kubenswrapper[2561]: I0909 19:10:47.509009    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75d4ff4d8d-hs5d8_8d69fb47-1ad6-4cdd-b4c4-f9f1bb865622/router/0.log"