Sep 11 18:46:35.795744 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 18:46:35.795759 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 18:46:35.795769 ip-10-0-134-233 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 18:46:35.796113 ip-10-0-134-233 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 18:46:46.031213 ip-10-0-134-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 18:46:46.031233 ip-10-0-134-233 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2ac2a738bd8b4859bca814ee935ac8be --
Sep 11 18:48:41.400879 ip-10-0-134-233 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 18:48:41.773031 ip-10-0-134-233 kubenswrapper[2587]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:48:41.773031 ip-10-0-134-233 kubenswrapper[2587]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 18:48:41.773031 ip-10-0-134-233 kubenswrapper[2587]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:48:41.773031 ip-10-0-134-233 kubenswrapper[2587]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 18:48:41.773031 ip-10-0-134-233 kubenswrapper[2587]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 18:48:41.774554 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.774465    2587 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 18:48:41.778312 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778277    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.778312 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778308    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.778312 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778314    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.778312 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778319    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778324    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778329    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778333    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778341    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778346    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778351    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778355    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778360    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778369    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778373    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778411    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.778548 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778463    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778469    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778620    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778625    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778628    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778631    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778634    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778637    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778640    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778642    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778645    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778648    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778651    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778653    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778657    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778659    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778662    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778665    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778668    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778673    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.778955 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778677    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778683    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778687    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778706    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778709    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778712    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778715    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778718    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778721    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778723    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778726    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778729    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778733    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778737    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778740    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778743    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778747    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778751    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778755    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.779437 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778758    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778761    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778764    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778766    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778769    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778771    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778774    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778776    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778781    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778784    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778786    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778789    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778791    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778794    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778797    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778800    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778803    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778806    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778808    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778811    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.779941 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778814    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778817    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778819    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778822    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778824    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778827    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778830    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778833    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778835    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778838    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778840    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778843    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778846    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778849    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778852    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778854    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778857    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778859    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778862    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778864    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.780414 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778867    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778869    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778872    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778876    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.778879    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779619    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779629    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779632    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779635    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779638    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779640    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779644    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779647    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779651    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779655    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779658    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779661    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779663    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779667    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.780946 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779670    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779673    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779675    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779679    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779681    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779684    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779686    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779689    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779692    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779694    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779697    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779699    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779702    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779704    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779707    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779709    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779712    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779715    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779717    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779720    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.781466 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779722    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779725    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779727    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779730    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779733    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779736    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779739    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779743    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779746    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779749    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779752    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779756    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779759    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779762    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779765    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779768    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779772    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779774    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779779    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.781991 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779783    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779786    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779789    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779791    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779794    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779797    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779799    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779802    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779804    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779807    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779810    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779812    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779815    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779817    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779820    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779822    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779825    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779828    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779831    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779834    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.782468 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779837    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779839    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779842    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779844    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779848    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779850    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779853    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779857    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779860    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779862    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779865    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779868    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779871    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779873    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779876    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779878    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779881    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779883    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779886    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779888    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.782961 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779891    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779893    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779896    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779898    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779901    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.779904    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780290    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780295    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780298    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780301    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780304    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780307    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780311    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780315    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780318    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780321    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780325    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780328    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780331    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.783442 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780334    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780337    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780340    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780344    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780347    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780350    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780353    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780356    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780358    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780361    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780364    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780367    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780370    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780373    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780376    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780379    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780382    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780385    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780388    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780391    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.783942 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780394    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780397    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780399    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780402    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780404    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780407    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780410    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780412    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780415    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780420    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780423    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780426    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780428    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780431    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780434    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780436    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780439    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780442    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780445    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780448    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.784424 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780451    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780454    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780456    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780459    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780461    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780464    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780467    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780469    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780472    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780476    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780480    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780483    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780485    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780488    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780491    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780494    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780496    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780500    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780504    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.784905 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780507    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780509    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780512    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780515    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780518    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780521    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780523    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780526    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780528    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780531    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780534    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780537    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780540    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780542    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780545    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780547    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780549    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780552    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780554    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780557    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.785363 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780560    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780563    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780565    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780568    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780570    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780573    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.780576    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780675    2587 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780721    2587 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780730    2587 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780735    2587 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780739    2587 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780742    2587 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780747    2587 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780752    2587 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780758    2587 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780761    2587 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780765    2587 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780769    2587 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780772    2587 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780775    2587 flags.go:64] FLAG: --cgroup-root=""
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780778    2587 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780781    2587 flags.go:64] FLAG: --client-ca-file=""
Sep 11 18:48:41.785891 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780785    2587 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780789    2587 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780793    2587 flags.go:64] FLAG: --cluster-domain=""
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780795    2587 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780799    2587 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780802    2587 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780805    2587 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780809    2587 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780812    2587 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780815    2587 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780818    2587 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780821    2587 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780824    2587 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780827    2587 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780830    2587 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780834    2587 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780838    2587 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780841    2587 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780844    2587 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780847    2587 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780850    2587 flags.go:64] FLAG: --enable-server="true"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780853    2587 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780858    2587 flags.go:64] FLAG: --event-burst="100"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780861    2587 flags.go:64] FLAG: --event-qps="50"
Sep 11 18:48:41.786559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780866    2587 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780870    2587 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780873    2587 flags.go:64] FLAG: --eviction-hard=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780877    2587 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780880    2587 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780883    2587 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780886    2587 flags.go:64] FLAG: --eviction-soft=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780889    2587 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780892    2587 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780896    2587 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780899    2587 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780902    2587 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780905    2587 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780908    2587 flags.go:64] FLAG: --feature-gates=""
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780912    2587 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780914    2587 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780917    2587 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780920    2587 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780924    2587 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780927    2587 flags.go:64] FLAG: --help="false"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780929    2587 flags.go:64] FLAG: --hostname-override="ip-10-0-134-233.ec2.internal"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780932    2587 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780935    2587 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 18:48:41.787166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780938    2587 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780942    2587 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780945    2587 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780948    2587 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780951    2587 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780954    2587 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780958    2587 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780961    2587 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780964    2587 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780968    2587 flags.go:64] FLAG: --kube-reserved=""
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780971    2587 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780974    2587 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780977    2587 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780980    2587 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780982    2587 flags.go:64] FLAG: --lock-file=""
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780985    2587 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780988    2587 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.780991    2587 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781001    2587 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781005    2587 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781008    2587 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781011    2587 flags.go:64] FLAG: --logging-format="text"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781013    2587 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781017    2587 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 18:48:41.787778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781019    2587 flags.go:64] FLAG: --manifest-url=""
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781022    2587 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781027    2587 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781030    2587 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781034    2587 flags.go:64] FLAG: --max-pods="110"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781037    2587 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781040    2587 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781043    2587 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781046    2587 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781049    2587 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781052    2587 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781055    2587 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781061    2587 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781064    2587 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781066    2587 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781070    2587 flags.go:64] FLAG: --pod-cidr=""
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781074    2587 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781081    2587 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781084    2587 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781087    2587 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781090    2587 flags.go:64] FLAG: --port="10250"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781093    2587 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781096    2587 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1e8b349884ea5e3"
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781099    2587 flags.go:64] FLAG: --qos-reserved=""
Sep 11 18:48:41.788377 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781103    2587 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781106    2587 flags.go:64] FLAG: --register-node="true"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781109    2587 flags.go:64] FLAG: --register-with-taints=""
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781112    2587 flags.go:64] FLAG: --registry-burst="10"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781116    2587 flags.go:64] FLAG: --registry-qps="5"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781119    2587 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781122    2587 flags.go:64] FLAG: --reserved-memory=""
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781126    2587 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781129    2587 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781132    2587 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781135    2587 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781138    2587 flags.go:64] FLAG: --runonce="false"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781140    2587 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781144    2587 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781147    2587 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781150    2587 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781153    2587 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781156    2587 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781159    2587 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781162    2587 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781165    2587 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781168    2587 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781171    2587 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781174    2587 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781177    2587 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 18:48:41.788977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781183    2587 flags.go:64] FLAG: --system-cgroups=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781186    2587 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781191    2587 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781194    2587 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781197    2587 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781201    2587 flags.go:64] FLAG: --tls-min-version=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781204    2587 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781207    2587 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781210    2587 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781213    2587 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781216    2587 flags.go:64] FLAG: --v="2"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781220    2587 flags.go:64] FLAG: --version="false"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781226    2587 flags.go:64] FLAG: --vmodule=""
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781229    2587 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.781233    2587 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781377    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781382    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781385    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781388    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781391    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781393    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781396    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781399    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.789585 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781401    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781404    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781406    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781409    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781412    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781414    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781417    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781420    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781422    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781428    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781430    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781433    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781436    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781438    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781441    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781443    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781446    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781449    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781451    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781454    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.790189 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781456    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781459    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781468    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781472    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781476    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781479    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781482    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781485    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781488    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781491    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781494    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781497    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781499    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781502    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781505    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781508    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781511    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781514    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781516    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781519    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.790703 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781522    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781527    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781529    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781532    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781535    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781537    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781540    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781543    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781545    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781548    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781552    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781555    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781558    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781561    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781565    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781572    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781576    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781578    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781581    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.791199 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781584    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781586    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781589    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781608    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781611    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781614    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781617    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781619    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781622    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781625    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781628    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781630    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781633    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781636    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781642    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781644    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781647    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781650    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781652    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781655    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.791705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781657    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781660    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781663    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781665    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781668    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781670    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781673    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781675    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781678    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781682    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781684    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.781687    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.782275    2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.789460    2587 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.789478    2587 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 18:48:41.792198 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.789499    2587 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.789505    2587 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789562    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789567    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789570    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789574    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789577    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789579    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789582    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789585    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789588    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789608    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789612    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789615    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789618    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789621    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789624    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789627    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789630    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.792563 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789633    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789636    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789638    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789641    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789644    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789646    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789649    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789651    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789654    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789657    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789660    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789663    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789668    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789671    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789674    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789678    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789682    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789685    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789688    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789690    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.793041 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789693    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789695    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789698    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789701    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789703    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789706    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789709    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789712    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789715    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789717    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789720    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789722    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789725    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789728    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789730    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789733    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789735    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789738    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789740    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789743    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.793557 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789746    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789749    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789753    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789756    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789760    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789763    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789766    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789769    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789772    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789776    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789780    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789783    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789786    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789789    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789792    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789795    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789797    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789800    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789803    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.794057 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789805    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789808    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789811    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789813    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789816    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789819    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789821    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789824    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789826    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789829    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789831    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789834    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789836    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789839    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789841    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789844    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789847    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789850    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789853    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789856    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.794530 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789859    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789861    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789864    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.789869    2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789983    2587 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789989    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789992    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789995    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.789998    2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790001    2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790006    2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790009    2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790011    2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790014    2587 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 18:48:41.795037 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790017    2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790019    2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790022    2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790024    2587 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790027    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790030    2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790033    2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790035    2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790038    2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790042    2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790046    2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790049    2587 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790052    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790055    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790057    2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790060    2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790063    2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790066    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790070    2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 18:48:41.795395 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790073    2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790075    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790078    2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790081    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790083    2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790086    2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790088    2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790091    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790093    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790096    2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790099    2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790101    2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790104    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790106    2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790109    2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790111    2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790114    2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790116    2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790119    2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790121    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 18:48:41.795879 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790124    2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790126    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790129    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790131    2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790134    2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790136    2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790139    2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790141    2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790144    2587 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790147    2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790150    2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790154    2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790158    2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790161    2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790163    2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790167    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790170    2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790173    2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790175    2587 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790178    2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 18:48:41.796360 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790181    2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790183    2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790186    2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790189    2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790192    2587 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790195    2587 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790198    2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790200    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790203    2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790206    2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790209    2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790213    2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790216    2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790218    2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790221    2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790223    2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790226    2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790228    2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790231    2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790233    2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 18:48:41.797012 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790237    2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790239    2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790242    2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790245    2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790247    2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790251    2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790253    2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790256    2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790258    2587 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:41.790261    2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.790266    2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.790407    2587 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.794636    2587 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.795406    2587 server.go:1019] "Starting client certificate rotation"
Sep 11 18:48:41.797500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.795503    2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:48:41.797857 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.795539    2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 18:48:41.798307 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.798293    2587 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:48:41.804375 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.804357    2587 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 18:48:41.813970 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.813949    2587 log.go:25] "Validated CRI v1 runtime API"
Sep 11 18:48:41.817017 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.816998    2587 log.go:25] "Validated CRI v1 image API"
Sep 11 18:48:41.817864 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.817845    2587 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 18:48:41.821018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.820999    2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:48:41.823568 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.823546    2587 fs.go:135] Filesystem UUIDs: map[219917d1-f8ea-4e32-a54a-9dd2459ef202:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f8e00aea-2651-4d24-b6be-49aa4198b909:/dev/nvme0n1p3]
Sep 11 18:48:41.823653 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.823567    2587 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 18:48:41.829239 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.829122    2587 manager.go:216] Machine: {Timestamp:2026-09-11 18:48:41.827970611 +0000 UTC m=+0.314894482 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098528 MemoryCapacity:33164464128 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201031a6244577e4ba831d49287d9f SystemUUID:ec201031-a624-4577-e4ba-831d49287d9f BootID:2ac2a738-bd8b-4859-bca8-14ee935ac8be Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582230016 Type:vfs Inodes:4048396 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:d2:ec:20:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:d2:ec:20:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:78:de:9b:fa:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164464128 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 18:48:41.829239 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.829236    2587 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 18:48:41.829356 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.829325    2587 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 18:48:41.832185 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.832157    2587 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 18:48:41.832341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.832190    2587 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 18:48:41.832864 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.832853    2587 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 18:48:41.832895 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.832867    2587 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 18:48:41.832895 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.832876    2587 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:48:41.833466 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.833456    2587 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 18:48:41.834311 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.834300    2587 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 18:48:41.838083 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838070    2587 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:48:41.838209 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838199    2587 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 18:48:41.838244 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838229    2587 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 18:48:41.838244 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838240    2587 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 18:48:41.838300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838254    2587 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 18:48:41.838300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838265    2587 kubelet.go:398] "Adding apiserver pod source"
Sep 11 18:48:41.838300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838274    2587 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 18:48:41.838691 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838679    2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:48:41.838757 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.838704    2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 18:48:41.841107 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.841090    2587 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 18:48:41.843216 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.843202    2587 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 18:48:41.843268 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.843233    2587 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 18:48:41.844906 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844889    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844910    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844916    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844922    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844930    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844936    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844950    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844955    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844961    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 18:48:41.844965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844967    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 18:48:41.845243 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844976    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 18:48:41.845243 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.844983    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 18:48:41.846029 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.845946    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 18:48:41.846029 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.845994    2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 18:48:41.849557 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.849533    2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 18:48:41.849661 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.849533    2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 18:48:41.849661 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.849652    2587 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 18:48:41.850696 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.850681    2587 server.go:1268] "Started kubelet"
Sep 11 18:48:41.850768 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.850738    2587 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 18:48:41.850833 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.850768    2587 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 18:48:41.850880 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.850858    2587 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 18:48:41.851729 ip-10-0-134-233 systemd[1]: Started Kubernetes Kubelet.
Sep 11 18:48:41.852778 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.851960    2587 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 18:48:41.852845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.852809    2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmtbc"
Sep 11 18:48:41.853527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.853407    2587 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 18:48:41.856301 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.856280    2587 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 18:48:41.858332 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.857411    2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-233.ec2.internal.18d458bd41e6d04c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-233.ec2.internal,UID:ip-10-0-134-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-233.ec2.internal,},FirstTimestamp:2026-09-11 18:48:41.850638412 +0000 UTC m=+0.337562282,LastTimestamp:2026-09-11 18:48:41.850638412 +0000 UTC m=+0.337562282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-233.ec2.internal,}"
Sep 11 18:48:41.858332 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.858331    2587 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 18:48:41.858496 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.858347    2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 18:48:41.858496 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.858404    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:41.859257 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859239    2587 factory.go:55] Registering systemd factory
Sep 11 18:48:41.859257 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859258    2587 factory.go:223] Registration of the systemd container factory successfully
Sep 11 18:48:41.859441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859360    2587 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 18:48:41.859441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859363    2587 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 18:48:41.859441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859378    2587 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 18:48:41.859577 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859501    2587 factory.go:153] Registering CRI-O factory
Sep 11 18:48:41.859577 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859526    2587 factory.go:223] Registration of the crio container factory successfully
Sep 11 18:48:41.859577 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859531    2587 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 18:48:41.859577 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859543    2587 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 18:48:41.859759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859580    2587 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 18:48:41.859759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859621    2587 factory.go:103] Registering Raw factory
Sep 11 18:48:41.859759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.859638    2587 manager.go:1196] Started watching for new ooms in manager
Sep 11 18:48:41.860183 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.860167    2587 manager.go:349] Starting recovery of all containers
Sep 11 18:48:41.864661 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.864641    2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmtbc"
Sep 11 18:48:41.866026 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.865998    2587 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 18:48:41.866214 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.866193    2587 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 18:48:41.870265 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.870245    2587 manager.go:354] Recovery completed
Sep 11 18:48:41.878099 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.877981    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:41.880239 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880220    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:41.880324 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880252    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:41.880324 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880267    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:41.880946 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880934    2587 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 18:48:41.880946 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880944    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:41.881054 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.880944    2587 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 18:48:41.881054 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.881004    2587 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 18:48:41.881662 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.881649    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:41.881727 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.881677    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:41.881727 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.881691    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:41.882244 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.882164    2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-233.ec2.internal.18d458bd43aa7a1c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-233.ec2.internal,UID:ip-10-0-134-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-233.ec2.internal,},FirstTimestamp:2026-09-11 18:48:41.88023862 +0000 UTC m=+0.367162490,LastTimestamp:2026-09-11 18:48:41.88023862 +0000 UTC m=+0.367162490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-233.ec2.internal,}"
Sep 11 18:48:41.883111 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.883098    2587 policy_none.go:49] "None policy: Start"
Sep 11 18:48:41.883193 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.883117    2587 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 18:48:41.883193 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.883130    2587 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 18:48:41.885181 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.885167    2587 policy_none.go:47] "Start"
Sep 11 18:48:41.913259 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913236    2587 manager.go:337] "Starting Device Plugin manager"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.913287    2587 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913302    2587 server.go:87] "Starting device plugin registration server"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913728    2587 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913743    2587 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913823    2587 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913911    2587 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.913919    2587 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.914490    2587 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 18:48:41.937098 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.914568    2587 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:41.987535 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.987484    2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 18:48:41.988899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.988873    2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 18:48:41.989018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.988936    2587 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 18:48:41.989018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.988973    2587 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 18:48:41.989122 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:41.989100    2587 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 18:48:41.991319 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:41.991302    2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:48:42.014561 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.014530    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:42.015639 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.015622    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:42.015728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.015655    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:42.015728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.015670    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:42.015728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.015702    2587 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.021693 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.021679    2587 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.021737 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.021702    2587 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-233.ec2.internal\": node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.041846 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.041772    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.089239 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.089208    2587 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"]
Sep 11 18:48:42.089394 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.089286    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:42.090893 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.090876    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:42.090973 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.090904    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:42.090973 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.090917    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:42.093060 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.093047    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:42.093192 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.093176    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.093226 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.093207    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:42.094205 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094183    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:42.094205 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094190    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:42.094205 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094208    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:42.094368 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094214    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:42.094368 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094222    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:42.094368 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.094225    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:42.096425 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.096406    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.096509 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.096437    2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 18:48:42.097128 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.097113    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 18:48:42.097195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.097144    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 18:48:42.097195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.097158    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeHasSufficientPID"
Sep 11 18:48:42.118322 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.118295    2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-233.ec2.internal\" not found" node="ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.122807 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.122789    2587 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-233.ec2.internal\" not found" node="ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.142312 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.142286    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.160501 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.160476    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.160578 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.160504    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.160578 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.160523    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/784c1f32afb3a32b6f40a782dfed06fe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"784c1f32afb3a32b6f40a782dfed06fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.242984 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.242953    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.260916 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260890    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.261042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260919    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.261042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260935    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/784c1f32afb3a32b6f40a782dfed06fe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"784c1f32afb3a32b6f40a782dfed06fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.261042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260962    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/784c1f32afb3a32b6f40a782dfed06fe-config\") pod \"kube-apiserver-proxy-ip-10-0-134-233.ec2.internal\" (UID: \"784c1f32afb3a32b6f40a782dfed06fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.261042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260997    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.261042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.260997    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c15b9175ba06f99f2c45d155c6a8cda8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal\" (UID: \"c15b9175ba06f99f2c45d155c6a8cda8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.343402 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.343318    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.424973 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.424936    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.425266 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.425238    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:42.444428 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.444407    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.549008 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.548953    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.650819 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.650719    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.751683 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.751641    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.796041 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.796004    2587 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 18:48:42.796511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.796188    2587 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 18:48:42.852145 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.852114    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:42.869865 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.869832    2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 18:43:42 +0000 UTC" deadline="2028-02-22 18:51:55.031502401 +0000 UTC"
Sep 11 18:48:42.869865 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:42.869861    2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12696h3m12.161644844s"
Sep 11 18:48:42.954150 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:42.954121    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:43.054850 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.054811    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:43.105522 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:43.105478    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15b9175ba06f99f2c45d155c6a8cda8.slice/crio-a51bd8326d480e664777de43f1f8547329245fb7a99c877b946a56e735c02e7f WatchSource:0}: Error finding container a51bd8326d480e664777de43f1f8547329245fb7a99c877b946a56e735c02e7f: Status 404 returned error can't find the container with id a51bd8326d480e664777de43f1f8547329245fb7a99c877b946a56e735c02e7f
Sep 11 18:48:43.105714 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:43.105697    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784c1f32afb3a32b6f40a782dfed06fe.slice/crio-d864170baa1b0e4acac044029387d88dd5e2dd0c8eaaabe2204d21844e90cf75 WatchSource:0}: Error finding container d864170baa1b0e4acac044029387d88dd5e2dd0c8eaaabe2204d21844e90cf75: Status 404 returned error can't find the container with id d864170baa1b0e4acac044029387d88dd5e2dd0c8eaaabe2204d21844e90cf75
Sep 11 18:48:43.109770 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.109748    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:48:43.156611 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.156570    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:43.257253 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.257160    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:43.293582 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.293552    2587 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:48:43.343576 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.343541    2587 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:48:43.358099 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.358069    2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-233.ec2.internal\" not found"
Sep 11 18:48:43.418489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.418460    2587 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:48:43.461394 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.461359    2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:43.473182 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.473160    2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:48:43.474247 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.474230    2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal"
Sep 11 18:48:43.483707 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.483683    2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 18:48:43.638312 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.638223    2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 18:48:43.840343 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.840308    2587 apiserver.go:52] "Watching apiserver"
Sep 11 18:48:43.845812 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.845785    2587 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 18:48:43.846387 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.846362    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k9lrz","kube-system/konnectivity-agent-kjwj4","kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rjzk2","openshift-image-registry/node-ca-gft9g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-t6v67","openshift-multus/network-metrics-daemon-vb2fq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz","openshift-dns/node-resolver-mpwjw","openshift-multus/multus-8c2z9","openshift-network-diagnostics/network-check-target-nzcvr","openshift-network-operator/iptables-alerter-2hh9g","openshift-ovn-kubernetes/ovnkube-node-f5v58"]
Sep 11 18:48:43.849195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.849172    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.851640    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.851930    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.852155    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.852480    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.852716    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 18:48:43.853150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.852988    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rx5lr\""
Sep 11 18:48:43.854100 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.853234    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.854382 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.854362    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.856691 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.856671    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.857129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.857111    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.858058 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.858034    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9j8fz\""
Sep 11 18:48:43.858294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.858274    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.858360 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.858328    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.858538 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.858520    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 18:48:43.859180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859159    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.859270 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859192    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 18:48:43.859421 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859403    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 18:48:43.859615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859597    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 18:48:43.859775 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859759    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.860681 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.859930    2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 18:48:43.860681 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.860384    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.860681 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.860486    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lw4mw\""
Sep 11 18:48:43.861059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.860735    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 18:48:43.861059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.860815    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nnv5w\""
Sep 11 18:48:43.861170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861062    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.861170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861072    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 18:48:43.861507 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861487    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kml6w\""
Sep 11 18:48:43.861704 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861685    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.861794 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861695    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.861860 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.861805    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:43.861943 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.861902    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:43.864542 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.864511    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.866868 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.866786    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.866868 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.866817    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.867676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.867635    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rvf2k\""
Sep 11 18:48:43.867931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.867670    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 18:48:43.869614 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.868317    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:43.869614 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.868443    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:43.871325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.871300    2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 18:48:43.871943 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.871921    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:43.872047 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.871985    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkfk\" (UniqueName: \"kubernetes.io/projected/623e9114-94aa-476c-b99e-b50205526c95-kube-api-access-fnkfk\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.872111 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872044    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.872111 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872078    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-log-socket\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872220 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872186    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872221    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-config\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872334 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872301    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-run\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.872391 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872332    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-lib-modules\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.872391 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872367    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-systemd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872483 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872452    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.872531 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872484    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-kubelet\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872590 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872542    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-etc-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.872661 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872611    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-conf\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.872758 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872704    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-host-slash\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.872860 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872798    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-socket-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.873044 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.872921    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/7823bb77-72e4-438b-8cd0-26b5a3e001f8-kube-api-access-pghdp\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.873125 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873070    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.873181 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873137    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-netd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.873237 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873181    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4dz\" (UniqueName: \"kubernetes.io/projected/f3f577fd-5fb4-49bc-8954-4ed487ee0178-kube-api-access-nc4dz\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.873284 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873241    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.873342 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873287    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.873400 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873347    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-netns\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.873400 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873389    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.873527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.873507    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-node-log\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.874735    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.874921    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.874735    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-slash\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875022    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtlfb\" (UniqueName: \"kubernetes.io/projected/9a0553da-84be-413c-9626-f0c93c399fa3-kube-api-access-vtlfb\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875054    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-bin\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875086    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875111    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-sys\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875133    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-var-lib-kubelet\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875157    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7411469-29bb-4036-8a5b-71a987dfba94-host\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875181    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-device-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875208    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-tmp\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.875256 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875228    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7411469-29bb-4036-8a5b-71a987dfba94-serviceca\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875250    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875295    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-systemd\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875324    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875347    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysconfig\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875373    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-kube-api-access-wtb9r\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875416    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-ovn\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875441    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbws\" (UniqueName: \"kubernetes.io/projected/a7411469-29bb-4036-8a5b-71a987dfba94-kube-api-access-tvbws\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875468    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-system-cni-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875494    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875519    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mgfth\""
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875526    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-var-lib-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875628    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-registration-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875661    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-sys-fs\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875708    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cnibin\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875736    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-iptables-alerter-script\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875766    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-systemd-units\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.876067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875791    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4s2\" (UniqueName: \"kubernetes.io/projected/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-kube-api-access-9q4s2\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875815    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-modprobe-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875839    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-kubernetes\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875848    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875862    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-tuned\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875910    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875945    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-env-overrides\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.875971    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-host\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.876003    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-script-lib\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.876949    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.876985    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s9nm6\""
Sep 11 18:48:43.877296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.877112    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 18:48:43.877919 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.877545    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.880010 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.879989    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5x2tk\""
Sep 11 18:48:43.880174 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.880150    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:43.880240 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.880191    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 18:48:43.880240 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.880220    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:43.899378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.899353    2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6hv79"
Sep 11 18:48:43.914895 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.914873    2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6hv79"
Sep 11 18:48:43.960559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.960511    2587 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 18:48:43.977037 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977003    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977049    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysconfig\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977080    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-kube-api-access-wtb9r\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977111    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-cni-binary-copy\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977135    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4g6w\" (UniqueName: \"kubernetes.io/projected/a322a997-1dc7-4c48-a0f6-79272f0def6d-kube-api-access-n4g6w\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977161    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca506917-ed36-4055-88e6-53f9f1e1ec40-konnectivity-ca\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977167    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysconfig\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977186    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-ovn\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977236    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbws\" (UniqueName: \"kubernetes.io/projected/a7411469-29bb-4036-8a5b-71a987dfba94-kube-api-access-tvbws\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977262    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-ovn\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977261    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-system-cni-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977313    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-hostroot\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977340    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977362    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-system-cni-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977370    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-var-lib-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977405    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-registration-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977413    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-var-lib-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977432    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-sys-fs\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977462    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cnibin\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977485    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-iptables-alerter-script\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977508    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-hosts-file\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977521    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-registration-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977535    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btrq7\" (UniqueName: \"kubernetes.io/projected/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-kube-api-access-btrq7\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977560    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cnibin\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977572    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977605    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-systemd-units\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977609    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-sys-fs\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977666    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4s2\" (UniqueName: \"kubernetes.io/projected/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-kube-api-access-9q4s2\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977692    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-systemd-units\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977716    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-modprobe-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977742    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-kubernetes\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977769    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-tuned\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977769    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977800    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.977856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977834    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-tmp-dir\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977860    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-env-overrides\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977896    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-host\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977926    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-script-lib\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977944    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-kubernetes\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.977975    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-multus-certs\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978006    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978034    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca506917-ed36-4055-88e6-53f9f1e1ec40-agent-certs\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978042    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-modprobe-d\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978063    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkfk\" (UniqueName: \"kubernetes.io/projected/623e9114-94aa-476c-b99e-b50205526c95-kube-api-access-fnkfk\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978106    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978122    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-host\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978133    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-log-socket\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978160    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978188    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-config\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978201    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-iptables-alerter-script\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978225    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-run\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.978436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978263    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-lib-modules\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978302    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-daemon-config\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978330    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-systemd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978357    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978381    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978407    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-socket-dir-parent\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978464    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-k8s-cni-cncf-io\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978492    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-bin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978526    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-kubelet-config\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978554    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-dbus\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978582    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-kubelet\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978615    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-etc-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978649    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-conf\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978696    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-host-slash\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978723    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-multus\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978753    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-etc-kubernetes\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978804    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-socket-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.979446 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978806    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978852    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-script-lib\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978880    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.978977    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-log-socket\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979078    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-socket-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979127    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979133    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-etc-openvswitch\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979078    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-sysctl-conf\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979203    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-host-slash\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979310    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-lib-modules\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979360    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-run\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979404    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/7823bb77-72e4-438b-8cd0-26b5a3e001f8-kube-api-access-pghdp\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979411    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovnkube-config\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979552    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979585    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-netd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979666    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4dz\" (UniqueName: \"kubernetes.io/projected/f3f577fd-5fb4-49bc-8954-4ed487ee0178-kube-api-access-nc4dz\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979660    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7823bb77-72e4-438b-8cd0-26b5a3e001f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.980361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979699    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979756    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979770    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-run-systemd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979775    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979813    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-netns\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979819    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979846    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979858    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-netd\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979879    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-system-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979904    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7823bb77-72e4-438b-8cd0-26b5a3e001f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979910    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-node-log\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979940    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-slash\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.979974    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-netns\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980039    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-slash\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980039    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-run-netns\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980069    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-kubelet\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980097    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-conf-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.981274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980111    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-node-log\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980123    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980170    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980160    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtlfb\" (UniqueName: \"kubernetes.io/projected/9a0553da-84be-413c-9626-f0c93c399fa3-kube-api-access-vtlfb\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980213    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-bin\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980252    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-cni-bin\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980300    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980355    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-sys\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980380    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-var-lib-kubelet\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980416    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7411469-29bb-4036-8a5b-71a987dfba94-host\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980436    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-sys\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980435    2587 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980477    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7411469-29bb-4036-8a5b-71a987dfba94-host\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980475    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-device-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980531    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-var-lib-kubelet\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980578    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-cnibin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980584    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-env-overrides\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980631    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-tmp\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.982153 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980621    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/623e9114-94aa-476c-b99e-b50205526c95-device-dir\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980664    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7411469-29bb-4036-8a5b-71a987dfba94-serviceca\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980693    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980752    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-systemd\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.980831    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980847    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-systemd\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:43.980937    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:44.480898887 +0000 UTC m=+2.967822761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.980956    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-host-kubelet\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.983086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.981191    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7411469-29bb-4036-8a5b-71a987dfba94-serviceca\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.984768 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.984735    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-ovn-node-metrics-cert\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.985540 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.985480    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-etc-tuned\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.986217 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.985803    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f577fd-5fb4-49bc-8954-4ed487ee0178-tmp\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.986989 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.986961    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbws\" (UniqueName: \"kubernetes.io/projected/a7411469-29bb-4036-8a5b-71a987dfba94-kube-api-access-tvbws\") pod \"node-ca-gft9g\" (UID: \"a7411469-29bb-4036-8a5b-71a987dfba94\") " pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:43.987710 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.987686    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtb9r\" (UniqueName: \"kubernetes.io/projected/6ef63a88-2a1b-465d-a8f5-a660c5d465ee-kube-api-access-wtb9r\") pod \"iptables-alerter-2hh9g\" (UID: \"6ef63a88-2a1b-465d-a8f5-a660c5d465ee\") " pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:43.988149 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.988122    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4s2\" (UniqueName: \"kubernetes.io/projected/344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf-kube-api-access-9q4s2\") pod \"ovnkube-node-f5v58\" (UID: \"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:43.990200 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.988996    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4dz\" (UniqueName: \"kubernetes.io/projected/f3f577fd-5fb4-49bc-8954-4ed487ee0178-kube-api-access-nc4dz\") pod \"tuned-rjzk2\" (UID: \"f3f577fd-5fb4-49bc-8954-4ed487ee0178\") " pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:43.998949 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.998901    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghdp\" (UniqueName: \"kubernetes.io/projected/7823bb77-72e4-438b-8cd0-26b5a3e001f8-kube-api-access-pghdp\") pod \"multus-additional-cni-plugins-t6v67\" (UID: \"7823bb77-72e4-438b-8cd0-26b5a3e001f8\") " pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:43.999777 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:43.999271    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" event={"ID":"784c1f32afb3a32b6f40a782dfed06fe","Type":"ContainerStarted","Data":"d864170baa1b0e4acac044029387d88dd5e2dd0c8eaaabe2204d21844e90cf75"}
Sep 11 18:48:44.001103 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.001073    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"c15b9175ba06f99f2c45d155c6a8cda8","Type":"ContainerStarted","Data":"a51bd8326d480e664777de43f1f8547329245fb7a99c877b946a56e735c02e7f"}
Sep 11 18:48:44.002040 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.002017    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkfk\" (UniqueName: \"kubernetes.io/projected/623e9114-94aa-476c-b99e-b50205526c95-kube-api-access-fnkfk\") pod \"aws-ebs-csi-driver-node-f4jmz\" (UID: \"623e9114-94aa-476c-b99e-b50205526c95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:44.002432 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.002406    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtlfb\" (UniqueName: \"kubernetes.io/projected/9a0553da-84be-413c-9626-f0c93c399fa3-kube-api-access-vtlfb\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:44.081996 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.081961    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-multus-certs\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.081996 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.081996    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082015    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca506917-ed36-4055-88e6-53f9f1e1ec40-agent-certs\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082047    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-daemon-config\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082076    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082089    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-multus-certs\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082100    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-socket-dir-parent\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082154    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-k8s-cni-cncf-io\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082175    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082180    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-bin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082216    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-k8s-cni-cncf-io\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082227    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-kubelet-config\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082254    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-dbus\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.082250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082257    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-bin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082305    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-kubelet-config\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082310    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-socket-dir-parent\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082312    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6ae45f75-7e48-476d-aad6-d35a1948b728-dbus\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082421    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-multus\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082450    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-etc-kubernetes\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082498    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-system-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082548    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-cni-multus\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082556    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-system-cni-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082587    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-etc-kubernetes\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082626    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-netns\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082655    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-kubelet\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082686    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-conf-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082711    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-run-netns\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082718    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082757    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-cnibin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082762    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-conf-dir\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082808    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-cni-binary-copy\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082819    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-cnibin\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.082905 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.082844    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082839    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-multus-daemon-config\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082756    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-host-var-lib-kubelet\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082851    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4g6w\" (UniqueName: \"kubernetes.io/projected/a322a997-1dc7-4c48-a0f6-79272f0def6d-kube-api-access-n4g6w\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.082903    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:44.582883416 +0000 UTC m=+3.069807298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082934    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca506917-ed36-4055-88e6-53f9f1e1ec40-konnectivity-ca\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082964    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-hostroot\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.082995    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-hosts-file\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083022    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btrq7\" (UniqueName: \"kubernetes.io/projected/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-kube-api-access-btrq7\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083055    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-tmp-dir\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083061    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a322a997-1dc7-4c48-a0f6-79272f0def6d-hostroot\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083136    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-hosts-file\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083398    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a322a997-1dc7-4c48-a0f6-79272f0def6d-cni-binary-copy\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083469    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-tmp-dir\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.083899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.083692    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca506917-ed36-4055-88e6-53f9f1e1ec40-konnectivity-ca\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:44.085180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.085142    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca506917-ed36-4055-88e6-53f9f1e1ec40-agent-certs\") pod \"konnectivity-agent-kjwj4\" (UID: \"ca506917-ed36-4055-88e6-53f9f1e1ec40\") " pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:44.090028 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.090006    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:44.090156 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.090033    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:44.090156 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.090051    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:44.090156 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.090127    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:44.590108937 +0000 UTC m=+3.077032822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:44.095656 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.095630    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btrq7\" (UniqueName: \"kubernetes.io/projected/24f987b3-d9b4-4f0d-a01e-e864320bb2a5-kube-api-access-btrq7\") pod \"node-resolver-mpwjw\" (UID: \"24f987b3-d9b4-4f0d-a01e-e864320bb2a5\") " pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.095772 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.095624    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4g6w\" (UniqueName: \"kubernetes.io/projected/a322a997-1dc7-4c48-a0f6-79272f0def6d-kube-api-access-n4g6w\") pod \"multus-8c2z9\" (UID: \"a322a997-1dc7-4c48-a0f6-79272f0def6d\") " pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.166260 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.166170    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t6v67"
Sep 11 18:48:44.182314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.182285    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hh9g"
Sep 11 18:48:44.191328 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.191302    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:48:44.198500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.198474    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rjzk2"
Sep 11 18:48:44.206546 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.206521    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gft9g"
Sep 11 18:48:44.214552 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.214525    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz"
Sep 11 18:48:44.222748 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.222726    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:48:44.230706 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.230679    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpwjw"
Sep 11 18:48:44.237706 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.237685    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8c2z9"
Sep 11 18:48:44.486236 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.486148    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:44.486377 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.486304    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:44.486377 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.486370    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:45.486351313 +0000 UTC m=+3.973275188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:44.586940 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.586907    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:44.587117 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.587080    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:44.587167 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.587155    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:45.587137143 +0000 UTC m=+4.074061008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:44.687353 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.687314    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:44.687559 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.687537    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:44.687648 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.687570    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:44.687648 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.687586    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:44.687761 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:44.687667    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:45.687647435 +0000 UTC m=+4.174571316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:44.918864 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.918777    2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:43:44 +0000 UTC" deadline="2028-02-14 09:51:25.769520527 +0000 UTC"
Sep 11 18:48:44.918864 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:44.918814    2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12495h2m40.850709824s"
Sep 11 18:48:45.210220 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.209989    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623e9114_94aa_476c_b99e_b50205526c95.slice/crio-eb18f62c48cbb7d4b2ae8f34c3de67cc571405e4687f70d91b35abb57efcfd9e WatchSource:0}: Error finding container eb18f62c48cbb7d4b2ae8f34c3de67cc571405e4687f70d91b35abb57efcfd9e: Status 404 returned error can't find the container with id eb18f62c48cbb7d4b2ae8f34c3de67cc571405e4687f70d91b35abb57efcfd9e
Sep 11 18:48:45.211105 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.211083    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca506917_ed36_4055_88e6_53f9f1e1ec40.slice/crio-ccecbba07838ec5da2b289bc14c2d3c3952b0a07402d0e1d924c5e86f5731f4c WatchSource:0}: Error finding container ccecbba07838ec5da2b289bc14c2d3c3952b0a07402d0e1d924c5e86f5731f4c: Status 404 returned error can't find the container with id ccecbba07838ec5da2b289bc14c2d3c3952b0a07402d0e1d924c5e86f5731f4c
Sep 11 18:48:45.213308 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.213281    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7411469_29bb_4036_8a5b_71a987dfba94.slice/crio-84630ccc7c53aefce6ff5f2fdb8f9fe62563d829dee302d0b70ea29989a29bcf WatchSource:0}: Error finding container 84630ccc7c53aefce6ff5f2fdb8f9fe62563d829dee302d0b70ea29989a29bcf: Status 404 returned error can't find the container with id 84630ccc7c53aefce6ff5f2fdb8f9fe62563d829dee302d0b70ea29989a29bcf
Sep 11 18:48:45.215644 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.215607    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef63a88_2a1b_465d_a8f5_a660c5d465ee.slice/crio-bb581ddcfdb84a4df22c439636740ff2466ae121a62453f170af2dafa0b68f5f WatchSource:0}: Error finding container bb581ddcfdb84a4df22c439636740ff2466ae121a62453f170af2dafa0b68f5f: Status 404 returned error can't find the container with id bb581ddcfdb84a4df22c439636740ff2466ae121a62453f170af2dafa0b68f5f
Sep 11 18:48:45.219997 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.219901    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f987b3_d9b4_4f0d_a01e_e864320bb2a5.slice/crio-6c249c0824db7fd2f8d379368837121db73c824e03587f3c6722980f0dff239e WatchSource:0}: Error finding container 6c249c0824db7fd2f8d379368837121db73c824e03587f3c6722980f0dff239e: Status 404 returned error can't find the container with id 6c249c0824db7fd2f8d379368837121db73c824e03587f3c6722980f0dff239e
Sep 11 18:48:45.220768 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.220698    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7823bb77_72e4_438b_8cd0_26b5a3e001f8.slice/crio-fbd36da1496147e184e0e8b25041662a1796fe442b52a18f77969028b9ace067 WatchSource:0}: Error finding container fbd36da1496147e184e0e8b25041662a1796fe442b52a18f77969028b9ace067: Status 404 returned error can't find the container with id fbd36da1496147e184e0e8b25041662a1796fe442b52a18f77969028b9ace067
Sep 11 18:48:45.222564 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.222538    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f577fd_5fb4_49bc_8954_4ed487ee0178.slice/crio-bb0e08deccaf44c7537b99bcb3d5438da243093c519e13dddeef33e33f6f3a1f WatchSource:0}: Error finding container bb0e08deccaf44c7537b99bcb3d5438da243093c519e13dddeef33e33f6f3a1f: Status 404 returned error can't find the container with id bb0e08deccaf44c7537b99bcb3d5438da243093c519e13dddeef33e33f6f3a1f
Sep 11 18:48:45.223803 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.223779    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344e1f4b_64ad_4f8b_b78a_a8fa9d207cdf.slice/crio-f6ac993266af4a6f72c7f36e34c723fe813c7189c8e93abc3ddd94371af4ab68 WatchSource:0}: Error finding container f6ac993266af4a6f72c7f36e34c723fe813c7189c8e93abc3ddd94371af4ab68: Status 404 returned error can't find the container with id f6ac993266af4a6f72c7f36e34c723fe813c7189c8e93abc3ddd94371af4ab68
Sep 11 18:48:45.225888 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:48:45.225828    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda322a997_1dc7_4c48_a0f6_79272f0def6d.slice/crio-71c8e2e0003b2277bf7778b73aa3737b0b236280ec511c199819c6b7f57d16f6 WatchSource:0}: Error finding container 71c8e2e0003b2277bf7778b73aa3737b0b236280ec511c199819c6b7f57d16f6: Status 404 returned error can't find the container with id 71c8e2e0003b2277bf7778b73aa3737b0b236280ec511c199819c6b7f57d16f6
Sep 11 18:48:45.494735 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.494704    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:45.494863 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.494846    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:45.494918 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.494909    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:47.494893571 +0000 UTC m=+5.981817435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:45.596286 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.596165    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:45.596459 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.596323    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:45.596459 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.596411    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:47.596389486 +0000 UTC m=+6.083313350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:45.698184 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.697495    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:45.698184 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.697693    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:45.698184 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.697721    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:45.698184 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.697736    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:45.698184 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.697802    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:47.697782093 +0000 UTC m=+6.184705967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:45.919728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.919582    2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 18:43:44 +0000 UTC" deadline="2028-03-14 13:13:50.689227207 +0000 UTC"
Sep 11 18:48:45.919728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.919658    2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13194h25m4.769573474s"
Sep 11 18:48:45.992629 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.992592    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:45.992810 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.992772    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:45.993218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.993195    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:45.993334 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.993302    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:45.993394 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:45.993370    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:45.993468 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:45.993447    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:46.018373 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.018332    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"f6ac993266af4a6f72c7f36e34c723fe813c7189c8e93abc3ddd94371af4ab68"}
Sep 11 18:48:46.021511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.021473    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerStarted","Data":"fbd36da1496147e184e0e8b25041662a1796fe442b52a18f77969028b9ace067"}
Sep 11 18:48:46.037886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.037846    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjwj4" event={"ID":"ca506917-ed36-4055-88e6-53f9f1e1ec40","Type":"ContainerStarted","Data":"ccecbba07838ec5da2b289bc14c2d3c3952b0a07402d0e1d924c5e86f5731f4c"}
Sep 11 18:48:46.040136 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.040103    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjzk2" event={"ID":"f3f577fd-5fb4-49bc-8954-4ed487ee0178","Type":"ContainerStarted","Data":"bb0e08deccaf44c7537b99bcb3d5438da243093c519e13dddeef33e33f6f3a1f"}
Sep 11 18:48:46.052582 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.052542    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpwjw" event={"ID":"24f987b3-d9b4-4f0d-a01e-e864320bb2a5","Type":"ContainerStarted","Data":"6c249c0824db7fd2f8d379368837121db73c824e03587f3c6722980f0dff239e"}
Sep 11 18:48:46.061942 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.061888    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hh9g" event={"ID":"6ef63a88-2a1b-465d-a8f5-a660c5d465ee","Type":"ContainerStarted","Data":"bb581ddcfdb84a4df22c439636740ff2466ae121a62453f170af2dafa0b68f5f"}
Sep 11 18:48:46.069540 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.069503    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gft9g" event={"ID":"a7411469-29bb-4036-8a5b-71a987dfba94","Type":"ContainerStarted","Data":"84630ccc7c53aefce6ff5f2fdb8f9fe62563d829dee302d0b70ea29989a29bcf"}
Sep 11 18:48:46.080409 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.080370    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz" event={"ID":"623e9114-94aa-476c-b99e-b50205526c95","Type":"ContainerStarted","Data":"eb18f62c48cbb7d4b2ae8f34c3de67cc571405e4687f70d91b35abb57efcfd9e"}
Sep 11 18:48:46.088471 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.088433    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" event={"ID":"784c1f32afb3a32b6f40a782dfed06fe","Type":"ContainerStarted","Data":"3d6fd86db0691db5da0e3db79635a55fea76b8de6fb544614e8568657fc37b34"}
Sep 11 18:48:46.094499 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.093801    2587 generic.go:356] "Generic (PLEG): container finished" podID="c15b9175ba06f99f2c45d155c6a8cda8" containerID="6cf29762bcf1976ada0428fde913f6edd7c1763325015624bc2a9122d32c74bf" exitCode=0
Sep 11 18:48:46.094499 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.093887    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"c15b9175ba06f99f2c45d155c6a8cda8","Type":"ContainerDied","Data":"6cf29762bcf1976ada0428fde913f6edd7c1763325015624bc2a9122d32c74bf"}
Sep 11 18:48:46.106222 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.105452    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8c2z9" event={"ID":"a322a997-1dc7-4c48-a0f6-79272f0def6d","Type":"ContainerStarted","Data":"71c8e2e0003b2277bf7778b73aa3737b0b236280ec511c199819c6b7f57d16f6"}
Sep 11 18:48:46.121398 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:46.120493    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-233.ec2.internal" podStartSLOduration=3.120472396 podStartE2EDuration="3.120472396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:46.106115496 +0000 UTC m=+4.593039396" watchObservedRunningTime="2026-09-11 18:48:46.120472396 +0000 UTC m=+4.607396280"
Sep 11 18:48:47.127312 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.127251    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" event={"ID":"c15b9175ba06f99f2c45d155c6a8cda8","Type":"ContainerStarted","Data":"73b2d78e8cbb8cd5010e9e7af348e23ff96ff584244941509cd435bb4ef48c6e"}
Sep 11 18:48:47.142257 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.142200    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-233.ec2.internal" podStartSLOduration=4.142179278 podStartE2EDuration="4.142179278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:48:47.141516052 +0000 UTC m=+5.628439933" watchObservedRunningTime="2026-09-11 18:48:47.142179278 +0000 UTC m=+5.629103150"
Sep 11 18:48:47.514078 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.513315    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:47.514078 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.513507    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:47.514078 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.513690    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:51.513671333 +0000 UTC m=+10.000595207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:47.614854 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.614212    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:47.614854 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.614386    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:47.614854 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.614451    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:51.61443349 +0000 UTC m=+10.101357353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:47.715175 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.715133    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:47.715390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.715327    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:47.715390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.715351    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:47.715390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.715364    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:47.715557 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.715426    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:51.715405767 +0000 UTC m=+10.202329629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:47.990777 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.990698    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:47.990777 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.990714    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:47.990985 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.990824    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:47.990985 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.990937    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:47.991083 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:47.991074    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:47.991216 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:47.991151    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:49.990343 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:49.989963    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:49.990343 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:49.990094    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:49.990343 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:49.990210    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:49.990343 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:49.990301    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:49.990992 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:49.990457    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:49.990992 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:49.990550    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:51.547978 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.547344    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:51.547978 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.547547    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:51.547978 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.547626    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:59.547608084 +0000 UTC m=+18.034531955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:51.648110 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.648061    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:51.648372 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.648344    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:51.648492 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.648424    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:59.648402829 +0000 UTC m=+18.135326708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:51.749642 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.749583    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:51.749815 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.749774    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:51.749815 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.749804    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:51.749944 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.749818    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:51.749944 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.749891    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:48:59.749871135 +0000 UTC m=+18.236794997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:51.991615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.990918    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:51.991615 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.991046    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:51.991615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.991408    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:51.991615 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.991500    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:51.991615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:51.991553    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:51.991976 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:51.991681    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:53.989626 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:53.989521    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:53.990803 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:53.990182    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:53.990803 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:53.990274    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:53.990803 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:53.990370    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:53.990803 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:53.990674    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:53.990803 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:53.990763    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:55.989567 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:55.989294    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:55.990017 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:55.989321    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:55.990017 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:55.989635    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:55.990017 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:55.989721    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:55.990017 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:55.989359    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:55.990017 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:55.989849    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:57.989389 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:57.989344    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:57.989856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:57.989354    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:57.989856 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:57.989481    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:48:57.989856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:57.989489    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:57.989856 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:57.989589    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:57.989856 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:57.989694    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:59.609885 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.609848    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:59.610312 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.610011    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:59.610312 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.610078    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:15.610061328 +0000 UTC m=+34.096985212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:48:59.710262 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.710211    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:59.710443 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.710403    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:59.710496 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.710480    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:15.710464202 +0000 UTC m=+34.197388062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:48:59.811060 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.811018    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:59.811272 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.811221    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:48:59.811272 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.811251    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:48:59.811272 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.811264    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:59.811420 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.811325    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:15.811309779 +0000 UTC m=+34.298233641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:48:59.989969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.989853    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:48:59.989969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.989853    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:48:59.990169 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.990016    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:48:59.990169 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.990080    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:48:59.990169 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:48:59.989853    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:48:59.990307 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:48:59.990180    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:01.990415 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:01.990379    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:01.990893 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:01.990465    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:01.990893 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:01.990492    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:01.990893 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:01.990556    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:01.990893 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:01.990581    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:01.990893 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:01.990660    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:03.169420 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:03.169330    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rjzk2" event={"ID":"f3f577fd-5fb4-49bc-8954-4ed487ee0178","Type":"ContainerStarted","Data":"a83b63b2303bd752135ca7feddaff5b7d0ba812edce5311a9ef84c5bb97861e8"}
Sep 11 18:49:03.191311 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:03.191258    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rjzk2" podStartSLOduration=3.410097072 podStartE2EDuration="21.191238902s" totalImagesPullingTime="17.78114183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:03.190832964 +0000 UTC m=+21.677756844" watchObservedRunningTime="2026-09-11 18:49:03.191238902 +0000 UTC m=+21.678162782"
Sep 11 18:49:03.990466 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:03.990211    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:03.990641 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:03.990278    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:03.990641 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:03.990508    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:03.990641 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:03.990286    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:03.990641 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:03.990630    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:03.990819 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:03.990692    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:04.172706 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.172666    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8c2z9" event={"ID":"a322a997-1dc7-4c48-a0f6-79272f0def6d","Type":"ContainerStarted","Data":"2d9eb7d386f835ab0813b3164155d7b9da0ab90d7e01131ea39b3111058f9fb8"}
Sep 11 18:49:04.175747 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175718    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"4316107832cb706bdf91a18ca6c840fd685508a09a3d394b295326a97e09bcf3"}
Sep 11 18:49:04.175883 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175789    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"98a7597d94131c7412554acd6600f38b2b35f80482f68a8a175ba41a38c924c0"}
Sep 11 18:49:04.175883 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175834    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"a378bafe6a28892b1e6ace3f6f448d283634f5ad8fdcc41df59de324706ded4f"}
Sep 11 18:49:04.175883 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175870    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"210c21953ed28e2917785f34b571233121eddedf0e5ccf20e3a097e123e0b3fb"}
Sep 11 18:49:04.176040 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175905    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"533c707cec63dc42dac6d96962a44daba5d2bf5dca15598cb9a43c6ab46b8db6"}
Sep 11 18:49:04.176040 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.175954    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"463d23eed9171462d6c01e4b460a3baa2013563cb0277efb5aef7cb09bb892a5"}
Sep 11 18:49:04.177283 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.177260    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="1f621b0e9189b5a45e2a610d8285054b15d796b7ff07bb3dd07bbb0ec9a02abc" exitCode=0
Sep 11 18:49:04.177381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.177335    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"1f621b0e9189b5a45e2a610d8285054b15d796b7ff07bb3dd07bbb0ec9a02abc"}
Sep 11 18:49:04.179159 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.179107    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjwj4" event={"ID":"ca506917-ed36-4055-88e6-53f9f1e1ec40","Type":"ContainerStarted","Data":"a5c32a4e2392d8f8151ef009de45470ae78981cc8857855f5903d4e3e608a835"}
Sep 11 18:49:04.180736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.180717    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpwjw" event={"ID":"24f987b3-d9b4-4f0d-a01e-e864320bb2a5","Type":"ContainerStarted","Data":"b5d957601d53abd8786b7248f2d75ca42b0e0cd31e990d8000521d1fce425c55"}
Sep 11 18:49:04.182158 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.182137    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gft9g" event={"ID":"a7411469-29bb-4036-8a5b-71a987dfba94","Type":"ContainerStarted","Data":"2926938918c6c1eac1d6be6a36a2025afc142c635457f69a818bd538305d34d8"}
Sep 11 18:49:04.183469 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.183450    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz" event={"ID":"623e9114-94aa-476c-b99e-b50205526c95","Type":"ContainerStarted","Data":"31c6d9530f3325af1e922693f153f082155667d3a5b7493bd5d7231bc651fa92"}
Sep 11 18:49:04.192225 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.192187    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8c2z9" podStartSLOduration=4.356664487 podStartE2EDuration="22.192174155s" totalImagesPullingTime="17.835509668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:04.191931411 +0000 UTC m=+22.678855291" watchObservedRunningTime="2026-09-11 18:49:04.192174155 +0000 UTC m=+22.679098076"
Sep 11 18:49:04.244299 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.244215    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gft9g" podStartSLOduration=4.455904726 podStartE2EDuration="22.244201268s" totalImagesPullingTime="17.788296542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:04.243448406 +0000 UTC m=+22.730372285" watchObservedRunningTime="2026-09-11 18:49:04.244201268 +0000 UTC m=+22.731125147"
Sep 11 18:49:04.263195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.263144    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mpwjw" podStartSLOduration=4.481488045 podStartE2EDuration="22.263124369s" totalImagesPullingTime="17.781636324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:04.262993122 +0000 UTC m=+22.749917001" watchObservedRunningTime="2026-09-11 18:49:04.263124369 +0000 UTC m=+22.750048250"
Sep 11 18:49:04.284248 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.284194    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjwj4" podStartSLOduration=11.835387273 podStartE2EDuration="22.284180245s" totalImagesPullingTime="10.448792972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:04.284125785 +0000 UTC m=+22.771049654" watchObservedRunningTime="2026-09-11 18:49:04.284180245 +0000 UTC m=+22.771104167"
Sep 11 18:49:04.501934 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.501717    2587 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 18:49:04.926746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.926510    2587 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T18:49:04.501931056Z","UUID":"2dc2e95e-8bb4-4590-b699-a2c7b81f9bb1","Handler":null,"Name":"","Endpoint":""}
Sep 11 18:49:04.928457 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.928435    2587 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 18:49:04.928589 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:04.928471    2587 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 18:49:05.187993 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.187905    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hh9g" event={"ID":"6ef63a88-2a1b-465d-a8f5-a660c5d465ee","Type":"ContainerStarted","Data":"f320dcb685772b6e71d1ab09c7d4a75eef592bfdfe576b8f5b7e0796fa47c448"}
Sep 11 18:49:05.190912 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.190877    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz" event={"ID":"623e9114-94aa-476c-b99e-b50205526c95","Type":"ContainerStarted","Data":"01b872b29d163bd2582b4ff2deefa559ea85690d0321b32944acf5dca81807a3"}
Sep 11 18:49:05.304582 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.304541    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:49:05.305301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.305276    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:49:05.334590 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.334535    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2hh9g" podStartSLOduration=5.550537283 podStartE2EDuration="23.334517549s" totalImagesPullingTime="17.783980266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:05.221870785 +0000 UTC m=+23.708794666" watchObservedRunningTime="2026-09-11 18:49:05.334517549 +0000 UTC m=+23.821441431"
Sep 11 18:49:05.990198 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.990111    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:05.990365 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.990110    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:05.990365 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:05.990251    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:05.990365 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:05.990111    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:05.990365 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:05.990310    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:05.990566 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:05.990396    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:06.195525 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:06.195478    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz" event={"ID":"623e9114-94aa-476c-b99e-b50205526c95","Type":"ContainerStarted","Data":"9d46dc9422da532881c9bb2bcd91aa01eea3d739b2d59879eaa47d1d9f6e4327"}
Sep 11 18:49:06.199286 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:06.199244    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"31d68875dc6964f5bb5118ab228dbf0f82f94d0e67de4cc03a0e4f7ad190d54d"}
Sep 11 18:49:06.199526 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:06.199500    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:49:06.200220 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:06.200198    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjwj4"
Sep 11 18:49:06.214129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:06.214073    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4jmz" podStartSLOduration=4.345467811 podStartE2EDuration="24.214057151s" totalImagesPullingTime="19.86858934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:06.213880958 +0000 UTC m=+24.700804840" watchObservedRunningTime="2026-09-11 18:49:06.214057151 +0000 UTC m=+24.700981031"
Sep 11 18:49:07.990393 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:07.990220    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:07.990393 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:07.990222    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:07.990393 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:07.990361    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:07.990393 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:07.990358    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:07.990905 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:07.990450    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:07.990905 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:07.990523    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:09.208813 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.208612    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" event={"ID":"344e1f4b-64ad-4f8b-b78a-a8fa9d207cdf","Type":"ContainerStarted","Data":"f65dec0608f2d4d5259baeb07fcaba6f64825f4d668368e4851f17cd6f55ed24"}
Sep 11 18:49:09.209317 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.208859    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:09.210576 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.210544    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="e45a1dbb00259fd4ba70c33984fed0b8f38483b2622fbe75b9108443eac6a6ad" exitCode=0
Sep 11 18:49:09.210700 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.210584    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"e45a1dbb00259fd4ba70c33984fed0b8f38483b2622fbe75b9108443eac6a6ad"}
Sep 11 18:49:09.224452 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.224430    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:09.235336 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.235293    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58" podStartSLOduration=9.403299576 podStartE2EDuration="27.235279967s" totalImagesPullingTime="17.831980391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:09.234730381 +0000 UTC m=+27.721654261" watchObservedRunningTime="2026-09-11 18:49:09.235279967 +0000 UTC m=+27.722203846"
Sep 11 18:49:09.989640 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.989589    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:09.989802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.989589    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:09.989802 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:09.989724    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:09.989802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:09.989590    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:09.989802 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:09.989790    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:09.990011 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:09.989860    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:10.115294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.115260    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9lrz"]
Sep 11 18:49:10.118390 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.118362    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nzcvr"]
Sep 11 18:49:10.118961 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.118939    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vb2fq"]
Sep 11 18:49:10.215527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.215335    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="6de2d677263bcecad4eda100d524a51d7048579ca7f914eabbf00ded57e38bf3" exitCode=0
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.215609    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.215420    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"6de2d677263bcecad4eda100d524a51d7048579ca7f914eabbf00ded57e38bf3"}
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.215649    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.215665    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:10.215739    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:10.215822    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:10.216170 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:10.215893    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:10.216795 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.216242    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:10.216795 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.216330    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:10.231398 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:10.231370    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:11.220585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:11.220546    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="dc506b379169fd9c516cc4fec577c78ac1470cc19890faf5c68b04d410411847" exitCode=0
Sep 11 18:49:11.220955 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:11.220608    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"dc506b379169fd9c516cc4fec577c78ac1470cc19890faf5c68b04d410411847"}
Sep 11 18:49:11.990672 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:11.990632    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:11.990845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:11.990734    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:11.990845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:11.990781    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:11.990845 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:11.990788    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:11.990986 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:11.990857    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:11.990986 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:11.990970    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:13.989302 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:13.989249    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:13.989302 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:13.989264    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:13.989952 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:13.989249    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:13.989952 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:13.989376    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:13.989952 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:13.989430    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:13.989952 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:13.989558    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:15.630553 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.630516    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:15.631029 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.630680    2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:49:15.631029 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.630743    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs podName:9a0553da-84be-413c-9626-f0c93c399fa3 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:47.630727533 +0000 UTC m=+66.117651390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs") pod "network-metrics-daemon-vb2fq" (UID: "9a0553da-84be-413c-9626-f0c93c399fa3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 18:49:15.731065 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.731028    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:15.731218 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.731140    2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 18:49:15.731218 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.731198    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret podName:6ae45f75-7e48-476d-aad6-d35a1948b728 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:47.731184401 +0000 UTC m=+66.218108261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret") pod "global-pull-secret-syncer-k9lrz" (UID: "6ae45f75-7e48-476d-aad6-d35a1948b728") : object "kube-system"/"original-pull-secret" not registered
Sep 11 18:49:15.832343 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.832307    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:15.832489 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.832437    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 18:49:15.832489 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.832450    2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 18:49:15.832489 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.832459    2587 projected.go:196] Error preparing data for projected volume kube-api-access-lf6xn for pod openshift-network-diagnostics/network-check-target-nzcvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:49:15.832584 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.832507    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn podName:6fea3c98-cfa2-4c90-80ff-84c71123bcf6 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:47.832492893 +0000 UTC m=+66.319416751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lf6xn" (UniqueName: "kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn") pod "network-check-target-nzcvr" (UID: "6fea3c98-cfa2-4c90-80ff-84c71123bcf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 18:49:15.989526 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.989492    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:15.989690 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.989505    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:15.989690 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:15.989647    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:15.989690 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.989645    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9lrz" podUID="6ae45f75-7e48-476d-aad6-d35a1948b728"
Sep 11 18:49:15.989862 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.989744    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb2fq" podUID="9a0553da-84be-413c-9626-f0c93c399fa3"
Sep 11 18:49:15.989862 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:15.989841    2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nzcvr" podUID="6fea3c98-cfa2-4c90-80ff-84c71123bcf6"
Sep 11 18:49:16.235218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.235131    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="8a77ca7a03f21c2f4fc41ca6e4022113d83eba4f133afdc8bf5c589873d7aeae" exitCode=0
Sep 11 18:49:16.235218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.235189    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"8a77ca7a03f21c2f4fc41ca6e4022113d83eba4f133afdc8bf5c589873d7aeae"}
Sep 11 18:49:16.838301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.838063    2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-233.ec2.internal" event="NodeReady"
Sep 11 18:49:16.838663 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.838360    2587 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 18:49:16.888430 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.888399    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d4wsk"]
Sep 11 18:49:16.909444 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.909408    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h2p8r"]
Sep 11 18:49:16.909605 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.909546    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:16.911636 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.911608    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 18:49:16.911760 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.911655    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-shf8m\""
Sep 11 18:49:16.911760 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.911740    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 18:49:16.912134 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.912117    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 18:49:16.925378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.925352    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4wsk"]
Sep 11 18:49:16.925492 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.925390    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h2p8r"]
Sep 11 18:49:16.925492 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.925475    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:16.927504 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.927479    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vlxp2\""
Sep 11 18:49:16.927627 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.927504    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 18:49:16.927627 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:16.927486    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 18:49:17.042134 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042084    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d65ea04-b065-4472-8239-bdf50ebbd480-cert\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.042134 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042133    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spv28\" (UniqueName: \"kubernetes.io/projected/3d65ea04-b065-4472-8239-bdf50ebbd480-kube-api-access-spv28\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.042381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042182    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzfv\" (UniqueName: \"kubernetes.io/projected/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-kube-api-access-rpzfv\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.042381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042199    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-tmp-dir\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.042381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042221    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-config-volume\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.042381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.042235    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143047 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.142965    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzfv\" (UniqueName: \"kubernetes.io/projected/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-kube-api-access-rpzfv\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143047 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143001    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-tmp-dir\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143047 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143033    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-config-volume\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143328 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143058    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143328 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:17.143187    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:17.143328 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143186    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d65ea04-b065-4472-8239-bdf50ebbd480-cert\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.143328 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:17.143245    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:17.643227565 +0000 UTC m=+36.130151432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:17.143328 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143272    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spv28\" (UniqueName: \"kubernetes.io/projected/3d65ea04-b065-4472-8239-bdf50ebbd480-kube-api-access-spv28\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.143567 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143544    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-tmp-dir\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.143836 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.143813    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-config-volume\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.147223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.147203    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d65ea04-b065-4472-8239-bdf50ebbd480-cert\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.151344 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.151321    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spv28\" (UniqueName: \"kubernetes.io/projected/3d65ea04-b065-4472-8239-bdf50ebbd480-kube-api-access-spv28\") pod \"ingress-canary-d4wsk\" (UID: \"3d65ea04-b065-4472-8239-bdf50ebbd480\") " pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.152852 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.152826    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzfv\" (UniqueName: \"kubernetes.io/projected/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-kube-api-access-rpzfv\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.221942 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.221901    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4wsk"
Sep 11 18:49:17.241051 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.241020    2587 generic.go:356] "Generic (PLEG): container finished" podID="7823bb77-72e4-438b-8cd0-26b5a3e001f8" containerID="19e24bc1b62839550da729f5681d13b2151600e632ec37949e9945d0ada3c878" exitCode=0
Sep 11 18:49:17.241174 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.241063    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerDied","Data":"19e24bc1b62839550da729f5681d13b2151600e632ec37949e9945d0ada3c878"}
Sep 11 18:49:17.563586 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.563553    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4wsk"]
Sep 11 18:49:17.567094 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:17.567072    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d65ea04_b065_4472_8239_bdf50ebbd480.slice/crio-5356b94af79fbf912d0dde45571e7a5bae779180875671284d77b6260fb24ca9 WatchSource:0}: Error finding container 5356b94af79fbf912d0dde45571e7a5bae779180875671284d77b6260fb24ca9: Status 404 returned error can't find the container with id 5356b94af79fbf912d0dde45571e7a5bae779180875671284d77b6260fb24ca9
Sep 11 18:49:17.648315 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.648282    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:17.648484 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:17.648391    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:17.648484 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:17.648451    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:18.648436131 +0000 UTC m=+37.135359988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:17.989216 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.989181    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:17.990005 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.989185    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:17.990005 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.989193    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:17.991960 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.991937    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:49:17.992112 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.992047    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 18:49:17.992112 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.992060    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:49:17.992314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.992189    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tr6q7\""
Sep 11 18:49:17.992314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.992195    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 18:49:17.992314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:17.992210    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kzbqc\""
Sep 11 18:49:18.249181 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:18.248375    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t6v67" event={"ID":"7823bb77-72e4-438b-8cd0-26b5a3e001f8","Type":"ContainerStarted","Data":"eee13ea495fccc498766344bcffd3061d7ec1b83856fdfb7f50d1661d8f45101"}
Sep 11 18:49:18.250990 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:18.250957    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4wsk" event={"ID":"3d65ea04-b065-4472-8239-bdf50ebbd480","Type":"ContainerStarted","Data":"5356b94af79fbf912d0dde45571e7a5bae779180875671284d77b6260fb24ca9"}
Sep 11 18:49:18.272449 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:18.272388    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t6v67" podStartSLOduration=8.504808107 podStartE2EDuration="36.272371609s" totalImagesPullingTime="27.767563502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:18.271551872 +0000 UTC m=+36.758475750" watchObservedRunningTime="2026-09-11 18:49:18.272371609 +0000 UTC m=+36.759295488"
Sep 11 18:49:18.653941 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:18.653826    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:18.654082 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:18.654008    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:18.654120 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:18.654103    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:20.654080816 +0000 UTC m=+39.141004680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:20.669376 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:20.669291    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:20.669376 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:20.669337    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:20.669815 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:20.669400    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:24.669385729 +0000 UTC m=+43.156309586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:21.259325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:21.259287    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4wsk" event={"ID":"3d65ea04-b065-4472-8239-bdf50ebbd480","Type":"ContainerStarted","Data":"33fc906e2ce2a374a55155d957463130611a82ced0bf30fde8ecaba722589e98"}
Sep 11 18:49:21.297277 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:21.297224    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d4wsk" podStartSLOduration=2.500589169 podStartE2EDuration="5.297205406s" totalImagesPullingTime="2.796616237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:21.29672717 +0000 UTC m=+39.783651043" watchObservedRunningTime="2026-09-11 18:49:21.297205406 +0000 UTC m=+39.784129275"
Sep 11 18:49:21.973302 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:21.973270    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"]
Sep 11 18:49:22.001858 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.001756    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"
Sep 11 18:49:22.004482 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.004454    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nqkx8\""
Sep 11 18:49:22.005160 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.005141    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"]
Sep 11 18:49:22.084167 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.084135    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:49:22.102420 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.102392    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74f86cdcc6-86wzz"]
Sep 11 18:49:22.102566 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.102511    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.104605 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.104565    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 18:49:22.104737 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.104718    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pqdcd\""
Sep 11 18:49:22.104892 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.104878    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 18:49:22.104946 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.104905    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 18:49:22.113005 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.112981    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 18:49:22.116556 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.116534    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74f86cdcc6-86wzz"]
Sep 11 18:49:22.116683 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.116562    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:49:22.116683 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.116655    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.118977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118913    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 18:49:22.118977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118946    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 18:49:22.118977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118961    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 18:49:22.118977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118970    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 18:49:22.119250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118987    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 18:49:22.119250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.118946    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pqx7l\""
Sep 11 18:49:22.119250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.119211    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 18:49:22.180614 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.180566    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/f70bf402-1c7a-413b-84fa-f2f3293a6cbe-kube-api-access-p4hhg\") pod \"network-check-source-6f8b768455-9rm2z\" (UID: \"f70bf402-1c7a-413b-84fa-f2f3293a6cbe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"
Sep 11 18:49:22.281487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281392    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/f70bf402-1c7a-413b-84fa-f2f3293a6cbe-kube-api-access-p4hhg\") pod \"network-check-source-6f8b768455-9rm2z\" (UID: \"f70bf402-1c7a-413b-84fa-f2f3293a6cbe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"
Sep 11 18:49:22.281487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281431    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281447    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281464    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6h9\" (UniqueName: \"kubernetes.io/projected/420d2003-c7b3-489e-bf79-9f37ba6a0526-kube-api-access-gb6h9\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.281487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281488    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sbbs\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281506    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281533    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281549    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-default-certificate\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281566    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281668    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-stats-auth\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281698    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281724    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281755    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.281863 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.281783    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.305106 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.305074    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/f70bf402-1c7a-413b-84fa-f2f3293a6cbe-kube-api-access-p4hhg\") pod \"network-check-source-6f8b768455-9rm2z\" (UID: \"f70bf402-1c7a-413b-84fa-f2f3293a6cbe\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"
Sep 11 18:49:22.310499 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.310477    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"
Sep 11 18:49:22.383090 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383056    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383240 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383222    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-stats-auth\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.383303 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383259    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383382 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383356    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383432 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383419    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383495 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383449    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.383562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383493    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383521    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383558    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6h9\" (UniqueName: \"kubernetes.io/projected/420d2003-c7b3-489e-bf79-9f37ba6a0526-kube-api-access-gb6h9\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.383751 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383649    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sbbs\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383751 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383677    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.383751 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383741    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.383965 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.383784    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.883761257 +0000 UTC m=+41.370685130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:22.383965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383812    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-default-certificate\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.383965 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.383945    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.384297    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.384319    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.384376    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.88435991 +0000 UTC m=+41.371283768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.384630    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.384710    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.384734    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:22.385051 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.384784    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:22.884767228 +0000 UTC m=+41.371691099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:22.386479 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.386442    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-default-certificate\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.386904 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.386882    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.386985 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.386924    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-stats-auth\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.387544 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.387526    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.391475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.391412    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.396019 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.395989    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6h9\" (UniqueName: \"kubernetes.io/projected/420d2003-c7b3-489e-bf79-9f37ba6a0526-kube-api-access-gb6h9\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.396134 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.396114    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sbbs\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.600059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.599983    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z"]
Sep 11 18:49:22.602675 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:22.602648    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70bf402_1c7a_413b_84fa_f2f3293a6cbe.slice/crio-484886452ec2141b08c8d082c48acbb2e22cd8da1ab5bbde18c88fc6e170c418 WatchSource:0}: Error finding container 484886452ec2141b08c8d082c48acbb2e22cd8da1ab5bbde18c88fc6e170c418: Status 404 returned error can't find the container with id 484886452ec2141b08c8d082c48acbb2e22cd8da1ab5bbde18c88fc6e170c418
Sep 11 18:49:22.888517 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.888434    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.888517 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.888475    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:22.888517 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:22.888502    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888606    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:23.888576327 +0000 UTC m=+42.375500189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888615    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888636    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888674    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:23.888662861 +0000 UTC m=+42.375586723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888621    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:22.888730 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:22.888709    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:23.888700018 +0000 UTC m=+42.375623876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:23.265896 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:23.265856    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z" event={"ID":"f70bf402-1c7a-413b-84fa-f2f3293a6cbe","Type":"ContainerStarted","Data":"484886452ec2141b08c8d082c48acbb2e22cd8da1ab5bbde18c88fc6e170c418"}
Sep 11 18:49:23.896890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:23.896852    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:23.897078 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:23.896904    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:23.897078 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:23.896943    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:23.897078 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897034    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:25.897012113 +0000 UTC m=+44.383935990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:23.897078 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897061    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:23.897261 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897091    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:23.897261 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897109    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:23.897261 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897121    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:25.897105114 +0000 UTC m=+44.384028977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:23.897261 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:23.897157    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:25.897141024 +0000 UTC m=+44.384064904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:24.703649 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:24.703589    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:24.704118 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:24.703774    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:24.704118 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:24.703852    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:32.703835747 +0000 UTC m=+51.190759609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:25.912343 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:25.912300    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:25.912394    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:25.912420    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912484    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912508    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912519    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912573    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:29.912552951 +0000 UTC m=+48.399476813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912613    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:29.912583259 +0000 UTC m=+48.399507117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:25.912871 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:25.912631    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:29.9126216 +0000 UTC m=+48.399545462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:26.274610 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:26.274558    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z" event={"ID":"f70bf402-1c7a-413b-84fa-f2f3293a6cbe","Type":"ContainerStarted","Data":"b3ba92d8db3cd84f3a27afe633f6571f83480833fd968e62d5bc1c36a07085f1"}
Sep 11 18:49:26.290245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:26.290182    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9rm2z" podStartSLOduration=2.213493613 podStartE2EDuration="5.290161417s" totalImagesPullingTime="3.076667804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:26.289352212 +0000 UTC m=+44.776276090" watchObservedRunningTime="2026-09-11 18:49:26.290161417 +0000 UTC m=+44.777085296"
Sep 11 18:49:29.943646 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:29.943585    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:29.943694    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:29.943722    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943738    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943804    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943815    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943807    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:37.943792143 +0000 UTC m=+56.430716000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943856    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:37.943844302 +0000 UTC m=+56.430768162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:29.944102 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:29.943869    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:37.943863925 +0000 UTC m=+56.430787782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:30.037424 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.037391    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6hmnx"]
Sep 11 18:49:30.067642 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.067609    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hmnx"]
Sep 11 18:49:30.067786 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.067711    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.070347 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.070324    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 18:49:30.070624 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.070609    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 18:49:30.070934 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.070920    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 18:49:30.071006 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.070933    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 18:49:30.071761 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.071730    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nt5d\""
Sep 11 18:49:30.145511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.145472    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldpk\" (UniqueName: \"kubernetes.io/projected/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-api-access-5ldpk\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.145705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.145539    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-crio-socket\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.145705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.145634    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-data-volume\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.145705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.145655    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.145705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.145673    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.246985 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.246906    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-crio-socket\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.246985 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.246974    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-data-volume\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.246992    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.247009    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.247090    2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.247125    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-crio-socket\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.247143    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:30.747123287 +0000 UTC m=+49.234047144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : configmap "kube-rbac-proxy" not found
Sep 11 18:49:30.247196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.247161    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldpk\" (UniqueName: \"kubernetes.io/projected/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-api-access-5ldpk\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.247470 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.247228    2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:30.247470 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.247294    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:30.747275761 +0000 UTC m=+49.234199621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:30.247470 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.247374    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-data-volume\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.257182 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.257151    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldpk\" (UniqueName: \"kubernetes.io/projected/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-api-access-5ldpk\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.751640 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.751578    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.751812 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:30.751651    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:30.751812 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.751704    2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:49:30.751812 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.751777    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:31.751757997 +0000 UTC m=+50.238681873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : configmap "kube-rbac-proxy" not found
Sep 11 18:49:30.751812 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.751797    2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:30.751968 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:30.751851    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:31.75183928 +0000 UTC m=+50.238763141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:31.758504 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:31.758461    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:31.758504 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:31.758502    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:31.758927 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:31.758585    2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:49:31.758927 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:31.758641    2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:31.758927 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:31.758673    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:33.758656484 +0000 UTC m=+52.245580346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : configmap "kube-rbac-proxy" not found
Sep 11 18:49:31.758927 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:31.758688    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:33.758681127 +0000 UTC m=+52.245604984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:32.766772 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:32.766732    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:32.767133 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:32.766905    2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 18:49:32.767133 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:32.766970    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls podName:1ba7a1dd-71f8-424c-8d60-fd43d6568a86 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:48.7669545 +0000 UTC m=+67.253878356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls") pod "dns-default-h2p8r" (UID: "1ba7a1dd-71f8-424c-8d60-fd43d6568a86") : secret "dns-default-metrics-tls" not found
Sep 11 18:49:32.805680 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:32.805647    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpwjw_24f987b3-d9b4-4f0d-a01e-e864320bb2a5/dns-node-resolver/0.log"
Sep 11 18:49:33.607213 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:33.607186    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gft9g_a7411469-29bb-4036-8a5b-71a987dfba94/node-ca/0.log"
Sep 11 18:49:33.774977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:33.774935    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:33.774977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:33.774978    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:33.775390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:33.775064    2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:49:33.775390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:33.775110    2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:33.775390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:33.775131    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:37.77511617 +0000 UTC m=+56.262040031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : configmap "kube-rbac-proxy" not found
Sep 11 18:49:33.775390 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:33.775157    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:37.775145027 +0000 UTC m=+56.262068885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:34.602362 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:34.602332    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4wsk_3d65ea04-b065-4472-8239-bdf50ebbd480/serve-healthcheck-canary/0.log"
Sep 11 18:49:37.809199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:37.809150    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:37.809199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:37.809205    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:37.809744 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:37.809276    2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 18:49:37.809744 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:37.809348    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:45.809333496 +0000 UTC m=+64.296257356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : configmap "kube-rbac-proxy" not found
Sep 11 18:49:37.809744 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:37.809375    2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:37.809744 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:37.809431    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls podName:8fc704cd-a5dd-47c1-8f3d-992cbfd00243 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:45.809419189 +0000 UTC m=+64.296343047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hmnx" (UID: "8fc704cd-a5dd-47c1-8f3d-992cbfd00243") : secret "insights-runtime-extractor-tls" not found
Sep 11 18:49:38.010796 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:38.010761    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:38.010972 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:38.010805    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:38.010972 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:38.010834    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:38.010972 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.010916    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:54.010894388 +0000 UTC m=+72.497818259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : configmap references non-existent config key: service-ca.crt
Sep 11 18:49:38.010972 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.010938    2587 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 18:49:38.011187 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.010971    2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 18:49:38.011187 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.010985    2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbd64bf5d-5w8tv: secret "image-registry-tls" not found
Sep 11 18:49:38.011187 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.010989    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs podName:420d2003-c7b3-489e-bf79-9f37ba6a0526 nodeName:}" failed. No retries permitted until 2026-09-11 18:49:54.010977586 +0000 UTC m=+72.497901457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs") pod "router-default-74f86cdcc6-86wzz" (UID: "420d2003-c7b3-489e-bf79-9f37ba6a0526") : secret "router-metrics-certs-default" not found
Sep 11 18:49:38.011187 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:49:38.011022    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls podName:a1f7761a-a30f-48f4-87d5-a32f22a9111b nodeName:}" failed. No retries permitted until 2026-09-11 18:49:54.011010593 +0000 UTC m=+72.497934453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls") pod "image-registry-6dbd64bf5d-5w8tv" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b") : secret "image-registry-tls" not found
Sep 11 18:49:42.233665 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:42.233636    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f5v58"
Sep 11 18:49:45.872534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.872495    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:45.872534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.872537    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:45.873241 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.873217    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:45.874811 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.874793    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8fc704cd-a5dd-47c1-8f3d-992cbfd00243-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hmnx\" (UID: \"8fc704cd-a5dd-47c1-8f3d-992cbfd00243\") " pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:45.979520 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.979488    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nt5d\""
Sep 11 18:49:45.988226 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:45.988206    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hmnx"
Sep 11 18:49:46.284920 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:46.284888    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hmnx"]
Sep 11 18:49:46.287762 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:46.287723    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc704cd_a5dd_47c1_8f3d_992cbfd00243.slice/crio-994b2d7c4d4bee7cfce0950db7996a18ee5c9463c4a5ad3ab3c40b8b57ae714c WatchSource:0}: Error finding container 994b2d7c4d4bee7cfce0950db7996a18ee5c9463c4a5ad3ab3c40b8b57ae714c: Status 404 returned error can't find the container with id 994b2d7c4d4bee7cfce0950db7996a18ee5c9463c4a5ad3ab3c40b8b57ae714c
Sep 11 18:49:46.323999 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:46.323970    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hmnx" event={"ID":"8fc704cd-a5dd-47c1-8f3d-992cbfd00243","Type":"ContainerStarted","Data":"994b2d7c4d4bee7cfce0950db7996a18ee5c9463c4a5ad3ab3c40b8b57ae714c"}
Sep 11 18:49:47.327970 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.327936    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hmnx" event={"ID":"8fc704cd-a5dd-47c1-8f3d-992cbfd00243","Type":"ContainerStarted","Data":"65e4b5d662aebea719f9ff28c87731e4854356540bb43ec088f27c0b20cfe919"}
Sep 11 18:49:47.686435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.686402    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:47.690132 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.690111    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 18:49:47.699263 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.699236    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a0553da-84be-413c-9626-f0c93c399fa3-metrics-certs\") pod \"network-metrics-daemon-vb2fq\" (UID: \"9a0553da-84be-413c-9626-f0c93c399fa3\") " pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:47.711702 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.711678    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kzbqc\""
Sep 11 18:49:47.719549 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.719532    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb2fq"
Sep 11 18:49:47.787076 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.787040    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:47.790292 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.790271    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 18:49:47.799383 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.799361    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6ae45f75-7e48-476d-aad6-d35a1948b728-original-pull-secret\") pod \"global-pull-secret-syncer-k9lrz\" (UID: \"6ae45f75-7e48-476d-aad6-d35a1948b728\") " pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:47.888109 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.888071    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:47.891096 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.891059    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6xn\" (UniqueName: \"kubernetes.io/projected/6fea3c98-cfa2-4c90-80ff-84c71123bcf6-kube-api-access-lf6xn\") pod \"network-check-target-nzcvr\" (UID: \"6fea3c98-cfa2-4c90-80ff-84c71123bcf6\") " pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:47.994132 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.994101    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vb2fq"]
Sep 11 18:49:47.996678 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:47.996652    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0553da_84be_413c_9626_f0c93c399fa3.slice/crio-215e6060f52a6d42f294770b9a537c8a069c3a69241204755c40880896de772e WatchSource:0}: Error finding container 215e6060f52a6d42f294770b9a537c8a069c3a69241204755c40880896de772e: Status 404 returned error can't find the container with id 215e6060f52a6d42f294770b9a537c8a069c3a69241204755c40880896de772e
Sep 11 18:49:47.999061 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:47.999039    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9lrz"
Sep 11 18:49:48.007195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.007172    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tr6q7\""
Sep 11 18:49:48.015084 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.015063    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:48.276025 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.275956    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9lrz"]
Sep 11 18:49:48.303656 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.303611    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nzcvr"]
Sep 11 18:49:48.331815 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.331775    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb2fq" event={"ID":"9a0553da-84be-413c-9626-f0c93c399fa3","Type":"ContainerStarted","Data":"215e6060f52a6d42f294770b9a537c8a069c3a69241204755c40880896de772e"}
Sep 11 18:49:48.334020 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.333986    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hmnx" event={"ID":"8fc704cd-a5dd-47c1-8f3d-992cbfd00243","Type":"ContainerStarted","Data":"e20fbc33ea06302e453a7cb7a7a0256ee81d7ff278e0dc73f5b1f121cb5776f8"}
Sep 11 18:49:48.605079 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:48.605005    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae45f75_7e48_476d_aad6_d35a1948b728.slice/crio-2bf0f30ca1b321b42870ed8fafeb45305c1c0fddf7f2b0453a1471f10db84412 WatchSource:0}: Error finding container 2bf0f30ca1b321b42870ed8fafeb45305c1c0fddf7f2b0453a1471f10db84412: Status 404 returned error can't find the container with id 2bf0f30ca1b321b42870ed8fafeb45305c1c0fddf7f2b0453a1471f10db84412
Sep 11 18:49:48.605710 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:48.605506    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fea3c98_cfa2_4c90_80ff_84c71123bcf6.slice/crio-9e8d35fdd656b5276afe591c2769b907ff50f1690b96bbdb63a7b52566a05891 WatchSource:0}: Error finding container 9e8d35fdd656b5276afe591c2769b907ff50f1690b96bbdb63a7b52566a05891: Status 404 returned error can't find the container with id 9e8d35fdd656b5276afe591c2769b907ff50f1690b96bbdb63a7b52566a05891
Sep 11 18:49:48.796048 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.795999    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:48.798661 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:48.798636    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ba7a1dd-71f8-424c-8d60-fd43d6568a86-metrics-tls\") pod \"dns-default-h2p8r\" (UID: \"1ba7a1dd-71f8-424c-8d60-fd43d6568a86\") " pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:49.039109 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.039080    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vlxp2\""
Sep 11 18:49:49.044333 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.044297    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:49.340821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.340784    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb2fq" event={"ID":"9a0553da-84be-413c-9626-f0c93c399fa3","Type":"ContainerStarted","Data":"770e8840a6d6fd1af5a0eca6b3e229e0f34ec002ac84c5e8e9255843d6173630"}
Sep 11 18:49:49.343094 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.342842    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nzcvr" event={"ID":"6fea3c98-cfa2-4c90-80ff-84c71123bcf6","Type":"ContainerStarted","Data":"731c401f3e4e0e810ad9499f177b382dc978e63ddbaaaf53c17a287530b9d2c1"}
Sep 11 18:49:49.343094 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.342899    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nzcvr" event={"ID":"6fea3c98-cfa2-4c90-80ff-84c71123bcf6","Type":"ContainerStarted","Data":"9e8d35fdd656b5276afe591c2769b907ff50f1690b96bbdb63a7b52566a05891"}
Sep 11 18:49:49.343347 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.343302    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:49:49.344971 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.344944    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9lrz" event={"ID":"6ae45f75-7e48-476d-aad6-d35a1948b728","Type":"ContainerStarted","Data":"2bf0f30ca1b321b42870ed8fafeb45305c1c0fddf7f2b0453a1471f10db84412"}
Sep 11 18:49:49.352333 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.351905    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hmnx" event={"ID":"8fc704cd-a5dd-47c1-8f3d-992cbfd00243","Type":"ContainerStarted","Data":"5d9e46fa0d5145664c7736ed4585745ddc6792924b5ddac85d9532017f465a94"}
Sep 11 18:49:49.362624 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.361307    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nzcvr" podStartSLOduration=67.361290387 podStartE2EDuration="1m7.361290387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:49.360904756 +0000 UTC m=+67.847828636" watchObservedRunningTime="2026-09-11 18:49:49.361290387 +0000 UTC m=+67.848214265"
Sep 11 18:49:49.387064 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.386995    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6hmnx" podStartSLOduration=17.218762507 podStartE2EDuration="19.386934496s" totalImagesPullingTime="2.168171989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:49:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:49.386575397 +0000 UTC m=+67.873499279" watchObservedRunningTime="2026-09-11 18:49:49.386934496 +0000 UTC m=+67.873858376"
Sep 11 18:49:49.473410 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:49.473380    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h2p8r"]
Sep 11 18:49:49.475999 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:49.475968    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba7a1dd_71f8_424c_8d60_fd43d6568a86.slice/crio-ac618865de19c40ceb0232f50ceac2d6725d7b034d764987072cbcd39c18ff44 WatchSource:0}: Error finding container ac618865de19c40ceb0232f50ceac2d6725d7b034d764987072cbcd39c18ff44: Status 404 returned error can't find the container with id ac618865de19c40ceb0232f50ceac2d6725d7b034d764987072cbcd39c18ff44
Sep 11 18:49:50.358279 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:50.358238    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h2p8r" event={"ID":"1ba7a1dd-71f8-424c-8d60-fd43d6568a86","Type":"ContainerStarted","Data":"ac618865de19c40ceb0232f50ceac2d6725d7b034d764987072cbcd39c18ff44"}
Sep 11 18:49:50.360848 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:50.360769    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb2fq" event={"ID":"9a0553da-84be-413c-9626-f0c93c399fa3","Type":"ContainerStarted","Data":"0b4728915b54ed566409bbcdd6fcee714ffb9485b218974ef00acf9f25915ee4"}
Sep 11 18:49:53.373029 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.372989    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h2p8r" event={"ID":"1ba7a1dd-71f8-424c-8d60-fd43d6568a86","Type":"ContainerStarted","Data":"cea3c0cb62e316f325af5ba76130a958492a33a6edd389e7d62e9084bedc759f"}
Sep 11 18:49:53.373502 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.373083    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:49:53.373502 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.373104    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h2p8r" event={"ID":"1ba7a1dd-71f8-424c-8d60-fd43d6568a86","Type":"ContainerStarted","Data":"46ba0d8d6e2642bed1bc63d74fe0e4887da42e3153cfe499b7df87b52ae3deb1"}
Sep 11 18:49:53.374364 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.374337    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9lrz" event={"ID":"6ae45f75-7e48-476d-aad6-d35a1948b728","Type":"ContainerStarted","Data":"7252a9a571f16206ba07aea237ea30f871b95bd40c4078f2a3be31d6c5c0084e"}
Sep 11 18:49:53.396945 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.396893    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vb2fq" podStartSLOduration=70.167677558 podStartE2EDuration="1m11.396879418s" totalImagesPullingTime="1.22920186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:50.378563088 +0000 UTC m=+68.865487025" watchObservedRunningTime="2026-09-11 18:49:53.396879418 +0000 UTC m=+71.883803287"
Sep 11 18:49:53.397693 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.397655    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h2p8r" podStartSLOduration=34.277886936 podStartE2EDuration="37.397645738s" totalImagesPullingTime="3.119758802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:53.397151495 +0000 UTC m=+71.884075373" watchObservedRunningTime="2026-09-11 18:49:53.397645738 +0000 UTC m=+71.884569616"
Sep 11 18:49:53.414302 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:53.414260    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k9lrz" podStartSLOduration=67.412439809 podStartE2EDuration="1m11.414247045s" totalImagesPullingTime="4.001807236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 18:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:53.413686847 +0000 UTC m=+71.900610727" watchObservedRunningTime="2026-09-11 18:49:53.414247045 +0000 UTC m=+71.901170953"
Sep 11 18:49:54.040767 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.040732    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:54.040971 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.040778    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:54.040971 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.040821    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:54.041397 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.041373    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420d2003-c7b3-489e-bf79-9f37ba6a0526-service-ca-bundle\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:54.043233 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.043197    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"image-registry-6dbd64bf5d-5w8tv\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") " pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:54.043366 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.043351    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d2003-c7b3-489e-bf79-9f37ba6a0526-metrics-certs\") pod \"router-default-74f86cdcc6-86wzz\" (UID: \"420d2003-c7b3-489e-bf79-9f37ba6a0526\") " pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:54.216585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.216553    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pqdcd\""
Sep 11 18:49:54.224590 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.224565    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:54.226780 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.226760    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pqx7l\""
Sep 11 18:49:54.235689 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.235662    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:54.502719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.502688    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:49:54.505143 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:54.505114    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f7761a_a30f_48f4_87d5_a32f22a9111b.slice/crio-43ea0e5fbe07ee078fcfb2a68deb152425838d8ac7270b9ac1bde699c39cb2b4 WatchSource:0}: Error finding container 43ea0e5fbe07ee078fcfb2a68deb152425838d8ac7270b9ac1bde699c39cb2b4: Status 404 returned error can't find the container with id 43ea0e5fbe07ee078fcfb2a68deb152425838d8ac7270b9ac1bde699c39cb2b4
Sep 11 18:49:54.526087 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:54.526056    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74f86cdcc6-86wzz"]
Sep 11 18:49:54.548376 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:54.548341    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420d2003_c7b3_489e_bf79_9f37ba6a0526.slice/crio-c31d28b9778aa76cb3ac4becc4ab1962211ff5a2b39acc2c6e49a6a15142b2e9 WatchSource:0}: Error finding container c31d28b9778aa76cb3ac4becc4ab1962211ff5a2b39acc2c6e49a6a15142b2e9: Status 404 returned error can't find the container with id c31d28b9778aa76cb3ac4becc4ab1962211ff5a2b39acc2c6e49a6a15142b2e9
Sep 11 18:49:55.373038 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.373001    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:49:55.385206 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.385169    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" event={"ID":"a1f7761a-a30f-48f4-87d5-a32f22a9111b","Type":"ContainerStarted","Data":"cbd824a5be738d14f5d7a9b94c5bcb6c0ff1298d397cc3c70243d790d99d092e"}
Sep 11 18:49:55.385395 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.385227    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" event={"ID":"a1f7761a-a30f-48f4-87d5-a32f22a9111b","Type":"ContainerStarted","Data":"43ea0e5fbe07ee078fcfb2a68deb152425838d8ac7270b9ac1bde699c39cb2b4"}
Sep 11 18:49:55.385395 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.385249    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:49:55.386665 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.386644    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74f86cdcc6-86wzz" event={"ID":"420d2003-c7b3-489e-bf79-9f37ba6a0526","Type":"ContainerStarted","Data":"c8a7a3b61745d494fe349933000f8c73bc5139d5163c39b6155f70cd9b5d5a95"}
Sep 11 18:49:55.386760 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.386680    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74f86cdcc6-86wzz" event={"ID":"420d2003-c7b3-489e-bf79-9f37ba6a0526","Type":"ContainerStarted","Data":"c31d28b9778aa76cb3ac4becc4ab1962211ff5a2b39acc2c6e49a6a15142b2e9"}
Sep 11 18:49:55.413704 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.413673    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-7drvw"]
Sep 11 18:49:55.418506 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.418487    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:49:55.420693 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.420664    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w5q2c\""
Sep 11 18:49:55.420804 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.420715    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 18:49:55.420868 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.420814    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 18:49:55.426220 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.426178    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" podStartSLOduration=33.426164168 podStartE2EDuration="33.426164168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:55.425994953 +0000 UTC m=+73.912918833" watchObservedRunningTime="2026-09-11 18:49:55.426164168 +0000 UTC m=+73.913088047"
Sep 11 18:49:55.432774 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.432749    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7drvw"]
Sep 11 18:49:55.496053 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.495992    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74f86cdcc6-86wzz" podStartSLOduration=33.495974958 podStartE2EDuration="33.495974958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:55.494533406 +0000 UTC m=+73.981457284" watchObservedRunningTime="2026-09-11 18:49:55.495974958 +0000 UTC m=+73.982898837"
Sep 11 18:49:55.512504 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.512463    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74c95d5c6b-hvz96"]
Sep 11 18:49:55.515845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.515821    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.536539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.536505    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c95d5c6b-hvz96"]
Sep 11 18:49:55.555495 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.555464    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9r6h\" (UniqueName: \"kubernetes.io/projected/161a3d9d-ce52-4a30-910f-b9c59c44d9c9-kube-api-access-k9r6h\") pod \"downloads-76f99584f4-7drvw\" (UID: \"161a3d9d-ce52-4a30-910f-b9c59c44d9c9\") " pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:49:55.656611 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656518    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncbdv\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-kube-api-access-ncbdv\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656611 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656558    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-ca-trust-extracted\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656611 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656589    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-bound-sa-token\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656792 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656633    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-trusted-ca\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656792 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656661    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9r6h\" (UniqueName: \"kubernetes.io/projected/161a3d9d-ce52-4a30-910f-b9c59c44d9c9-kube-api-access-k9r6h\") pod \"downloads-76f99584f4-7drvw\" (UID: \"161a3d9d-ce52-4a30-910f-b9c59c44d9c9\") " pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:49:55.656792 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656681    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-tls\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656792 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656750    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-installation-pull-secrets\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656908 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656791    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-image-registry-private-configuration\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.656908 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.656831    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-certificates\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.676180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.676146    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9r6h\" (UniqueName: \"kubernetes.io/projected/161a3d9d-ce52-4a30-910f-b9c59c44d9c9-kube-api-access-k9r6h\") pod \"downloads-76f99584f4-7drvw\" (UID: \"161a3d9d-ce52-4a30-910f-b9c59c44d9c9\") " pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:49:55.728515 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.728475    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:49:55.757746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757715    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncbdv\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-kube-api-access-ncbdv\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.757888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757757    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-ca-trust-extracted\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.757888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757792    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-bound-sa-token\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.757888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757821    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-trusted-ca\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.757888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757849    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-tls\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.757888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757879    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-installation-pull-secrets\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.758106 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757905    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-image-registry-private-configuration\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.758106 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.757943    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-certificates\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.758536 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.758478    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-ca-trust-extracted\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.758997 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.758972    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-certificates\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.759285 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.759252    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-trusted-ca\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.760524 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.760500    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-installation-pull-secrets\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.760633 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.760531    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-registry-tls\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.760633 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.760543    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-image-registry-private-configuration\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.783282 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.783252    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncbdv\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-kube-api-access-ncbdv\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.789229 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.789204    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d-bound-sa-token\") pod \"image-registry-74c95d5c6b-hvz96\" (UID: \"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d\") " pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:55.823769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:55.823731    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:56.022931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.022907    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-7drvw"]
Sep 11 18:49:56.024512 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:56.024481    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161a3d9d_ce52_4a30_910f_b9c59c44d9c9.slice/crio-00770944efc391aeaaa3fe2a58f9a30a5f55736e171ba9465143cb34d2e3dcff WatchSource:0}: Error finding container 00770944efc391aeaaa3fe2a58f9a30a5f55736e171ba9465143cb34d2e3dcff: Status 404 returned error can't find the container with id 00770944efc391aeaaa3fe2a58f9a30a5f55736e171ba9465143cb34d2e3dcff
Sep 11 18:49:56.108434 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.108402    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c95d5c6b-hvz96"]
Sep 11 18:49:56.111412 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:49:56.111378    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad574f9_e79a_4c5d_ab3c_fbcd9e2af60d.slice/crio-01d5280a75c37ed334628b4c69b74b92d059ddd378d8a90e9987bb1a6fbd8452 WatchSource:0}: Error finding container 01d5280a75c37ed334628b4c69b74b92d059ddd378d8a90e9987bb1a6fbd8452: Status 404 returned error can't find the container with id 01d5280a75c37ed334628b4c69b74b92d059ddd378d8a90e9987bb1a6fbd8452
Sep 11 18:49:56.236148 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.236103    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:56.238616 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.238566    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:56.391495 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.391397    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96" event={"ID":"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d","Type":"ContainerStarted","Data":"5cb40c892b10fdf5ca8397692d33895f7fff48460d1bbc3220e20f64b1952fdd"}
Sep 11 18:49:56.391495 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.391451    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96" event={"ID":"bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d","Type":"ContainerStarted","Data":"01d5280a75c37ed334628b4c69b74b92d059ddd378d8a90e9987bb1a6fbd8452"}
Sep 11 18:49:56.391753 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.391625    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:49:56.392920 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.392893    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7drvw" event={"ID":"161a3d9d-ce52-4a30-910f-b9c59c44d9c9","Type":"ContainerStarted","Data":"00770944efc391aeaaa3fe2a58f9a30a5f55736e171ba9465143cb34d2e3dcff"}
Sep 11 18:49:56.393129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.393114    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:56.394407 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.394384    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74f86cdcc6-86wzz"
Sep 11 18:49:56.416749 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:56.416678    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96" podStartSLOduration=1.416656731 podStartE2EDuration="1.416656731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:49:56.415763273 +0000 UTC m=+74.902687152" watchObservedRunningTime="2026-09-11 18:49:56.416656731 +0000 UTC m=+74.903580614"
Sep 11 18:49:59.724913 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.724874    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:49:59.728218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.728190    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.731033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.731006    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 18:49:59.731173 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.731031    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 18:49:59.732536 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.732504    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 18:49:59.732536 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.732516    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4n8bk\""
Sep 11 18:49:59.732747 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.732516    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 18:49:59.732747 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.732509    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 18:49:59.739106 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.739061    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:49:59.793077 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793042    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.793246 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793095    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvfj9\" (UniqueName: \"kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.793246 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793147    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.793246 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793192    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.793438 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793255    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.793438 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.793340    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894486    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894721 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894530    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894721 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894547    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894721 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894588    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894721 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894637    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvfj9\" (UniqueName: \"kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.894721 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.894665    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.895386 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.895326    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.895494 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.895405    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.895639 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.895620    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.897447 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.897423    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.897546 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.897447    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:49:59.903397 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:49:59.903368    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvfj9\" (UniqueName: \"kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9\") pod \"console-7b78df69d9-98x77\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") " pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:00.039625 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:00.039513    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:00.318748 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:00.318660    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:50:00.322335 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:00.322311    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc300ea5_3e1c_40fb_ae30_315d980f3795.slice/crio-832f9a2664f80843808906c94cfbbb7cf9faede797f2c1d11f1d6ffce3948a2c WatchSource:0}: Error finding container 832f9a2664f80843808906c94cfbbb7cf9faede797f2c1d11f1d6ffce3948a2c: Status 404 returned error can't find the container with id 832f9a2664f80843808906c94cfbbb7cf9faede797f2c1d11f1d6ffce3948a2c
Sep 11 18:50:00.413076 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:00.413041    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78df69d9-98x77" event={"ID":"dc300ea5-3e1c-40fb-ae30-315d980f3795","Type":"ContainerStarted","Data":"832f9a2664f80843808906c94cfbbb7cf9faede797f2c1d11f1d6ffce3948a2c"}
Sep 11 18:50:03.380761 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.380725    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h2p8r"
Sep 11 18:50:03.712305 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.712267    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:50:03.715785 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.715759    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.723939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.723688    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 18:50:03.728131 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.728103    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:50:03.829533 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829491    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829552    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829585    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829676    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829702    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829728    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.829939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.829782    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2tr\" (UniqueName: \"kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.930508 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930467    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.930769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930518    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.930769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930552    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.930769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930682    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.930769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930723    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.931105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930783    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2tr\" (UniqueName: \"kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.931105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.930830    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.932264 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.932215    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.933102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.933054    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.933102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.933071    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.933261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.933125    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.933738 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.933695    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.933962 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.933946    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:03.941944 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:03.941917    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2tr\" (UniqueName: \"kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr\") pod \"console-5865bcd8dd-8vp94\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") " pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:04.027218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.026931    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:04.312123 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.312036    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:50:04.315076 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:04.315044    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7423e4_22a2_4d14_a114_818058d1a095.slice/crio-3898a5007f4260d351508457a4a2f7936f89c7356ae5afad38918077aeae4e2c WatchSource:0}: Error finding container 3898a5007f4260d351508457a4a2f7936f89c7356ae5afad38918077aeae4e2c: Status 404 returned error can't find the container with id 3898a5007f4260d351508457a4a2f7936f89c7356ae5afad38918077aeae4e2c
Sep 11 18:50:04.432656 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.432615    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865bcd8dd-8vp94" event={"ID":"5a7423e4-22a2-4d14-a114-818058d1a095","Type":"ContainerStarted","Data":"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"}
Sep 11 18:50:04.433122 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.432681    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865bcd8dd-8vp94" event={"ID":"5a7423e4-22a2-4d14-a114-818058d1a095","Type":"ContainerStarted","Data":"3898a5007f4260d351508457a4a2f7936f89c7356ae5afad38918077aeae4e2c"}
Sep 11 18:50:04.434652 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.434618    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78df69d9-98x77" event={"ID":"dc300ea5-3e1c-40fb-ae30-315d980f3795","Type":"ContainerStarted","Data":"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"}
Sep 11 18:50:04.452144 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.452085    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5865bcd8dd-8vp94" podStartSLOduration=1.4520685119999999 podStartE2EDuration="1.452068512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:04.450860857 +0000 UTC m=+82.937784735" watchObservedRunningTime="2026-09-11 18:50:04.452068512 +0000 UTC m=+82.938992388"
Sep 11 18:50:04.471669 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:04.471603    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b78df69d9-98x77" podStartSLOduration=2.238854513 podStartE2EDuration="5.471568813s" totalImagesPullingTime="3.2327143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:04.469563496 +0000 UTC m=+82.956487375" watchObservedRunningTime="2026-09-11 18:50:04.471568813 +0000 UTC m=+82.958492692"
Sep 11 18:50:05.448488 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.448452    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"]
Sep 11 18:50:05.452904 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.452877    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.455872 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.455841    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 18:50:05.456013 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.455941    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 18:50:05.456013 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.455953    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 18:50:05.456124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.456074    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 18:50:05.456171 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.456125    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 18:50:05.456229 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.456204    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mmwpv\""
Sep 11 18:50:05.467922 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.467894    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"]
Sep 11 18:50:05.545030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.544975    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.545347 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.545316    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.545472 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.545449    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f772db9-5456-4c6c-a304-88f0438e3684-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.545617 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.545567    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zw9\" (UniqueName: \"kubernetes.io/projected/1f772db9-5456-4c6c-a304-88f0438e3684-kube-api-access-g5zw9\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.647142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.647097    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.647341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.647167    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.647341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.647221    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f772db9-5456-4c6c-a304-88f0438e3684-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.647341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.647273    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zw9\" (UniqueName: \"kubernetes.io/projected/1f772db9-5456-4c6c-a304-88f0438e3684-kube-api-access-g5zw9\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.648104 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.648047    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f772db9-5456-4c6c-a304-88f0438e3684-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.650082 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.650056    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.650082 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.650074    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f772db9-5456-4c6c-a304-88f0438e3684-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.657836 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.657810    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zw9\" (UniqueName: \"kubernetes.io/projected/1f772db9-5456-4c6c-a304-88f0438e3684-kube-api-access-g5zw9\") pod \"prometheus-operator-68bcd7f987-fzxfv\" (UID: \"1f772db9-5456-4c6c-a304-88f0438e3684\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:05.764832 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:05.764736    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"
Sep 11 18:50:10.040388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:10.040344    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:10.040924 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:10.040421    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:10.045954 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:10.045931    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:10.465419 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:10.465378    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:12.354181 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.354103    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv"]
Sep 11 18:50:12.357475 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:12.357438    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f772db9_5456_4c6c_a304_88f0438e3684.slice/crio-2660ada4fed091b647f896fb915776fa59452fe8e04def2fe2ebf21c9b14a306 WatchSource:0}: Error finding container 2660ada4fed091b647f896fb915776fa59452fe8e04def2fe2ebf21c9b14a306: Status 404 returned error can't find the container with id 2660ada4fed091b647f896fb915776fa59452fe8e04def2fe2ebf21c9b14a306
Sep 11 18:50:12.471423 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.471378    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-7drvw" event={"ID":"161a3d9d-ce52-4a30-910f-b9c59c44d9c9","Type":"ContainerStarted","Data":"4d5a0276421cb6f7310fa8239a26de1ed5f42ddcd03e2fe026570cfa3f74e13c"}
Sep 11 18:50:12.471633 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.471580    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:50:12.472876 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.472846    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv" event={"ID":"1f772db9-5456-4c6c-a304-88f0438e3684","Type":"ContainerStarted","Data":"2660ada4fed091b647f896fb915776fa59452fe8e04def2fe2ebf21c9b14a306"}
Sep 11 18:50:12.491689 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.491657    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-7drvw"
Sep 11 18:50:12.516261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:12.516188    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-7drvw" podStartSLOduration=1.362093433 podStartE2EDuration="17.516163253s" totalImagesPullingTime="16.15406982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:12.490586456 +0000 UTC m=+90.977510336" watchObservedRunningTime="2026-09-11 18:50:12.516163253 +0000 UTC m=+91.003087204"
Sep 11 18:50:14.028003 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.027959    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:14.028479 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.028041    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:14.034473 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.034257    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:14.484855 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.484805    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv" event={"ID":"1f772db9-5456-4c6c-a304-88f0438e3684","Type":"ContainerStarted","Data":"bf63dcdc1f84a4a6d72baac665ba51ee01b536b63288d249dc7378f1bd7f2002"}
Sep 11 18:50:14.485082 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.484883    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv" event={"ID":"1f772db9-5456-4c6c-a304-88f0438e3684","Type":"ContainerStarted","Data":"9cbb6368ffd8fc6246807c5336a7cbafeae23cddd5bf815fec3a606fab4ac47b"}
Sep 11 18:50:14.490178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.490136    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:50:14.502308 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.502247    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-fzxfv" podStartSLOduration=7.716138841 podStartE2EDuration="9.502224005s" totalImagesPullingTime="1.786085164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:14.50163171 +0000 UTC m=+92.988555589" watchObservedRunningTime="2026-09-11 18:50:14.502224005 +0000 UTC m=+92.989147886"
Sep 11 18:50:14.554387 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:14.554306    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:50:16.399298 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:16.399257    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:50:17.135997 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.135948    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"]
Sep 11 18:50:17.167115 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.167074    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"]
Sep 11 18:50:17.167359 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.167200    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.170220 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.170194    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 18:50:17.170484 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.170458    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kmwr2\""
Sep 11 18:50:17.170623 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.170459    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 18:50:17.222931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.222893    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t8l2q"]
Sep 11 18:50:17.250126 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.250092    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.254078 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.254037    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 18:50:17.254231 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.254198    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2wfkj\""
Sep 11 18:50:17.254501 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.254474    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 18:50:17.254620 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.254530    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 18:50:17.350772 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350731    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350782    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-wtmp\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350813    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw9q6\" (UniqueName: \"kubernetes.io/projected/b98931c3-dd7d-4c54-8f37-fa3347ff41be-kube-api-access-vw9q6\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350835    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-tls\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350857    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350883    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.350969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350905    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.350964    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-root\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.351017    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-metrics-client-ca\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.351083    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tlq\" (UniqueName: \"kubernetes.io/projected/3a080cb2-045a-48dc-9b47-c4486e06aeba-kube-api-access-p2tlq\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.351133    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98931c3-dd7d-4c54-8f37-fa3347ff41be-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.351179    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-sys\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.351251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.351209    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-textfile\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.403578 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.403501    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74c95d5c6b-hvz96"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451811    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-root\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451866    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-metrics-client-ca\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451902    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tlq\" (UniqueName: \"kubernetes.io/projected/3a080cb2-045a-48dc-9b47-c4486e06aeba-kube-api-access-p2tlq\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451934    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98931c3-dd7d-4c54-8f37-fa3347ff41be-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451942    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-root\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.451981    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-sys\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452028    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-textfile\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452100    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-sys\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452137    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452170    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-wtmp\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452197    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw9q6\" (UniqueName: \"kubernetes.io/projected/b98931c3-dd7d-4c54-8f37-fa3347ff41be-kube-api-access-vw9q6\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452244    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-tls\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452271    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452417    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-wtmp\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452458    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452494    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.454643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452675    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-metrics-client-ca\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.452821    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98931c3-dd7d-4c54-8f37-fa3347ff41be-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.453053    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.453062    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-textfile\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.456015    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.457835    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a080cb2-045a-48dc-9b47-c4486e06aeba-node-exporter-tls\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.458074    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.458435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.458258    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b98931c3-dd7d-4c54-8f37-fa3347ff41be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.482293 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.482223    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tlq\" (UniqueName: \"kubernetes.io/projected/3a080cb2-045a-48dc-9b47-c4486e06aeba-kube-api-access-p2tlq\") pod \"node-exporter-t8l2q\" (UID: \"3a080cb2-045a-48dc-9b47-c4486e06aeba\") " pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.483987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.483956    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw9q6\" (UniqueName: \"kubernetes.io/projected/b98931c3-dd7d-4c54-8f37-fa3347ff41be-kube-api-access-vw9q6\") pod \"openshift-state-metrics-67dcf8c979-bv87k\" (UID: \"b98931c3-dd7d-4c54-8f37-fa3347ff41be\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:17.560999 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.560961    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8l2q"
Sep 11 18:50:17.616042 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:17.615998    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a080cb2_045a_48dc_9b47_c4486e06aeba.slice/crio-66141f3446e13ff0bad6e242b49b37c3b0d0d7c99de85102c1a432c28001f9dc WatchSource:0}: Error finding container 66141f3446e13ff0bad6e242b49b37c3b0d0d7c99de85102c1a432c28001f9dc: Status 404 returned error can't find the container with id 66141f3446e13ff0bad6e242b49b37c3b0d0d7c99de85102c1a432c28001f9dc
Sep 11 18:50:17.779403 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:17.779357    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"
Sep 11 18:50:18.093766 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.093677    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k"]
Sep 11 18:50:18.098522 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:18.097106    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98931c3_dd7d_4c54_8f37_fa3347ff41be.slice/crio-96a3f94c06779e5a2159329f263a981178a0c1f2b8df6878fab674b5178bee95 WatchSource:0}: Error finding container 96a3f94c06779e5a2159329f263a981178a0c1f2b8df6878fab674b5178bee95: Status 404 returned error can't find the container with id 96a3f94c06779e5a2159329f263a981178a0c1f2b8df6878fab674b5178bee95
Sep 11 18:50:18.101029 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.100989    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:50:18.121609 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.121564    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.127861 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.127831    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 18:50:18.128102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.128080    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 18:50:18.128223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.127858    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 18:50:18.128223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.127925    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 18:50:18.128344 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.128245    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 18:50:18.130095 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.130071    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 18:50:18.131445 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.131418    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 18:50:18.131843 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.131824    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 18:50:18.132316 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.132067    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:50:18.132752 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.132734    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dw7w9\""
Sep 11 18:50:18.137289 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.137264    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 18:50:18.261213 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261178    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261228    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtq5\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-kube-api-access-2xtq5\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261274    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261310    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261340    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261372    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261405    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261457    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261481    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-web-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261504    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261526    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261564    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-out\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.261719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.261630    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363066    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363113    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-web-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363132    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363157    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363196    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-out\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363247    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363286    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363313    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtq5\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-kube-api-access-2xtq5\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363339    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363367    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363397    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363431    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363466    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.365014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.363958    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.371238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.367187    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.371238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.367200    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.371238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.368158    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70cbae5-bda0-408c-8f54-4fe8b3de8842-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.371238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.370523    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-web-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373144 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.372229    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-out\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373144 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.372704    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373144 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.373040    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.373474    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.373499    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.373694 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.373571    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-config-volume\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.374587 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.374563    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70cbae5-bda0-408c-8f54-4fe8b3de8842-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.382580 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.382451    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtq5\" (UniqueName: \"kubernetes.io/projected/c70cbae5-bda0-408c-8f54-4fe8b3de8842-kube-api-access-2xtq5\") pod \"alertmanager-main-0\" (UID: \"c70cbae5-bda0-408c-8f54-4fe8b3de8842\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.435154 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.435120    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 18:50:18.538826 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.538653    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k" event={"ID":"b98931c3-dd7d-4c54-8f37-fa3347ff41be","Type":"ContainerStarted","Data":"81f99aa60ee5cab81f65811d635b954a270aabed6cd5edc39bf2a624c4d09faf"}
Sep 11 18:50:18.538826 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.538730    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k" event={"ID":"b98931c3-dd7d-4c54-8f37-fa3347ff41be","Type":"ContainerStarted","Data":"4d0bca9e7918d557840df092e553de7dfbea24a7eebd61fdb11aaee238faf85c"}
Sep 11 18:50:18.538826 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.538762    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k" event={"ID":"b98931c3-dd7d-4c54-8f37-fa3347ff41be","Type":"ContainerStarted","Data":"96a3f94c06779e5a2159329f263a981178a0c1f2b8df6878fab674b5178bee95"}
Sep 11 18:50:18.540663 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.540622    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8l2q" event={"ID":"3a080cb2-045a-48dc-9b47-c4486e06aeba","Type":"ContainerStarted","Data":"66141f3446e13ff0bad6e242b49b37c3b0d0d7c99de85102c1a432c28001f9dc"}
Sep 11 18:50:18.768298 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:18.768162    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 18:50:18.938392 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:18.938344    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70cbae5_bda0_408c_8f54_4fe8b3de8842.slice/crio-729d30eff47ed6e71fcfbcb35070f203c7d4a434284695b8e22c9d9147cdde81 WatchSource:0}: Error finding container 729d30eff47ed6e71fcfbcb35070f203c7d4a434284695b8e22c9d9147cdde81: Status 404 returned error can't find the container with id 729d30eff47ed6e71fcfbcb35070f203c7d4a434284695b8e22c9d9147cdde81
Sep 11 18:50:19.551386 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:19.551149    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8l2q" event={"ID":"3a080cb2-045a-48dc-9b47-c4486e06aeba","Type":"ContainerStarted","Data":"ec7f18971241120a1f941c61ad6a2fec64a09d7d1e362f3de5b220a66ea23056"}
Sep 11 18:50:19.555243 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:19.555157    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"729d30eff47ed6e71fcfbcb35070f203c7d4a434284695b8e22c9d9147cdde81"}
Sep 11 18:50:20.364384 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:20.364349    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nzcvr"
Sep 11 18:50:20.562998 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:20.562955    2587 generic.go:356] "Generic (PLEG): container finished" podID="3a080cb2-045a-48dc-9b47-c4486e06aeba" containerID="ec7f18971241120a1f941c61ad6a2fec64a09d7d1e362f3de5b220a66ea23056" exitCode=0
Sep 11 18:50:20.563448 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:20.563048    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8l2q" event={"ID":"3a080cb2-045a-48dc-9b47-c4486e06aeba","Type":"ContainerDied","Data":"ec7f18971241120a1f941c61ad6a2fec64a09d7d1e362f3de5b220a66ea23056"}
Sep 11 18:50:21.413512 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.413465    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" podUID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" containerName="registry" containerID="cri-o://cbd824a5be738d14f5d7a9b94c5bcb6c0ff1298d397cc3c70243d790d99d092e" gracePeriod=30
Sep 11 18:50:21.569297 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.569266    2587 generic.go:356] "Generic (PLEG): container finished" podID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" containerID="cbd824a5be738d14f5d7a9b94c5bcb6c0ff1298d397cc3c70243d790d99d092e" exitCode=0
Sep 11 18:50:21.569771 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.569346    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" event={"ID":"a1f7761a-a30f-48f4-87d5-a32f22a9111b","Type":"ContainerDied","Data":"cbd824a5be738d14f5d7a9b94c5bcb6c0ff1298d397cc3c70243d790d99d092e"}
Sep 11 18:50:21.571731 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.571700    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k" event={"ID":"b98931c3-dd7d-4c54-8f37-fa3347ff41be","Type":"ContainerStarted","Data":"059085e44cd1c3b77a279e5e49db02bb5b5f31126307cf8a46924e4b0148b3ef"}
Sep 11 18:50:21.574088 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.574062    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8l2q" event={"ID":"3a080cb2-045a-48dc-9b47-c4486e06aeba","Type":"ContainerStarted","Data":"4a08f17c2a6ab83c6a109e068384feeb588752b27cdce1d538e18e6d7e716c8f"}
Sep 11 18:50:21.574218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.574112    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8l2q" event={"ID":"3a080cb2-045a-48dc-9b47-c4486e06aeba","Type":"ContainerStarted","Data":"6fa63065c760368ed9fbc387d834ae66b43e394343372a8e7bc068c79f5149bd"}
Sep 11 18:50:21.576017 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.575991    2587 generic.go:356] "Generic (PLEG): container finished" podID="c70cbae5-bda0-408c-8f54-4fe8b3de8842" containerID="ca1e6d2e2fef8bbb98fff92ca1f66dc9e833f544fa86d3d89cdaa76e7c09c022" exitCode=0
Sep 11 18:50:21.576147 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.576044    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerDied","Data":"ca1e6d2e2fef8bbb98fff92ca1f66dc9e833f544fa86d3d89cdaa76e7c09c022"}
Sep 11 18:50:21.598088 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.598031    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-bv87k" podStartSLOduration=2.032203695 podStartE2EDuration="4.598012074s" totalImagesPullingTime="2.565808379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:21.597801711 +0000 UTC m=+100.084725590" watchObservedRunningTime="2026-09-11 18:50:21.598012074 +0000 UTC m=+100.084935955"
Sep 11 18:50:21.632644 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.632540    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t8l2q" podStartSLOduration=2.800544491 podStartE2EDuration="4.632521424s" totalImagesPullingTime="1.728398266s" totalInitContainerRuntime="103.578667ms" isStatefulPod=true podCreationTimestamp="2026-09-11 18:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:21.629710632 +0000 UTC m=+100.116634518" watchObservedRunningTime="2026-09-11 18:50:21.632521424 +0000 UTC m=+100.119445328"
Sep 11 18:50:21.640043 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.640013    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:21.655217 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.655186    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.665310 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.665286    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:50:21.686178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.686131    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:21.692529 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692499    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sbbs\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.692713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692538    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.692713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692567    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.692713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692616    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.692713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692653    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.692995 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.692968    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.693207 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.693186    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.693371 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.693344    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:21.693522 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.693495    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets\") pod \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\" (UID: \"a1f7761a-a30f-48f4-87d5-a32f22a9111b\") "
Sep 11 18:50:21.694089 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694019    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:21.694089 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694060    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694158    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4v7\" (UniqueName: \"kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694219    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694376 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694262    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694376 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694319    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694376 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694355    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694532 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694379    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.694532 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694433    2587 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-certificates\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.694532 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.694452    2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7761a-a30f-48f4-87d5-a32f22a9111b-trusted-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.695791 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.695764    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:21.695890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.695804    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs" (OuterVolumeSpecName: "kube-api-access-4sbbs") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "kube-api-access-4sbbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:21.695991 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.695966    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:21.696410 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.696388    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:21.697309 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.697279    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:21.701967 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.701945    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a1f7761a-a30f-48f4-87d5-a32f22a9111b" (UID: "a1f7761a-a30f-48f4-87d5-a32f22a9111b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:50:21.795570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795478    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795534    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795579    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795632    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795657    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795688    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.795821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795736    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4v7\" (UniqueName: \"kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.796098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.795813    2587 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-installation-pull-secrets\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796139    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sbbs\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-kube-api-access-4sbbs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796160    2587 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-bound-sa-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796177    2587 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1f7761a-a30f-48f4-87d5-a32f22a9111b-ca-trust-extracted\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796317 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796191    2587 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1f7761a-a30f-48f4-87d5-a32f22a9111b-registry-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796317 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796209    2587 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1f7761a-a30f-48f4-87d5-a32f22a9111b-image-registry-private-configuration\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:21.796402 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796327    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.796402 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796353    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.796466 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796395    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.796544 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.796527    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.798105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.798082    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.798196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.798120    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.803829 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.803809    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4v7\" (UniqueName: \"kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7\") pod \"console-66c4bc4f75-lxkjj\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") " pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:21.963729 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:21.963689    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:22.273846 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.273813    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:22.276805 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:22.276769    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adb0cc6_9751_4276_8157_47fb9e13a359.slice/crio-5b0efb4506db3098899956364082dc9097a7fea511689495d8f9939da078bf33 WatchSource:0}: Error finding container 5b0efb4506db3098899956364082dc9097a7fea511689495d8f9939da078bf33: Status 404 returned error can't find the container with id 5b0efb4506db3098899956364082dc9097a7fea511689495d8f9939da078bf33
Sep 11 18:50:22.470922 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.470876    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-778458fdf5-thjbs"]
Sep 11 18:50:22.471265 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.471244    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" containerName="registry"
Sep 11 18:50:22.471265 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.471264    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" containerName="registry"
Sep 11 18:50:22.471504 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.471356    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" containerName="registry"
Sep 11 18:50:22.489296 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.489262    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.490858 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.490827    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-778458fdf5-thjbs"]
Sep 11 18:50:22.492018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.491644    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 18:50:22.492018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.491703    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wwjzn\""
Sep 11 18:50:22.492018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.491740    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 18:50:22.492018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.491971    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 18:50:22.492018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.491972    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 18:50:22.492393 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.492339    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 18:50:22.496812 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.496793    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 18:50:22.506948 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.506918    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507083 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.506977    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-federate-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507083 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507069    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-metrics-client-ca\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507200 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507112    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507200 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507160    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqm4h\" (UniqueName: \"kubernetes.io/projected/34ab5457-0a74-451e-ad9f-fd24d906ea25-kube-api-access-gqm4h\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507329 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507198    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-serving-certs-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507329 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507292    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.507428 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.507343    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.582435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.582348    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"
Sep 11 18:50:22.582874 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.582354    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbd64bf5d-5w8tv" event={"ID":"a1f7761a-a30f-48f4-87d5-a32f22a9111b","Type":"ContainerDied","Data":"43ea0e5fbe07ee078fcfb2a68deb152425838d8ac7270b9ac1bde699c39cb2b4"}
Sep 11 18:50:22.582874 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.582491    2587 scope.go:117] "RemoveContainer" containerID="cbd824a5be738d14f5d7a9b94c5bcb6c0ff1298d397cc3c70243d790d99d092e"
Sep 11 18:50:22.585350 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.585321    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c4bc4f75-lxkjj" event={"ID":"4adb0cc6-9751-4276-8157-47fb9e13a359","Type":"ContainerStarted","Data":"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"}
Sep 11 18:50:22.585469 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.585370    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c4bc4f75-lxkjj" event={"ID":"4adb0cc6-9751-4276-8157-47fb9e13a359","Type":"ContainerStarted","Data":"5b0efb4506db3098899956364082dc9097a7fea511689495d8f9939da078bf33"}
Sep 11 18:50:22.607823 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.607788    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-serving-certs-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.607963 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.607845    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.607963 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.607900    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608073 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.607988    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608135 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.608119    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-federate-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608248 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.608233    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-metrics-client-ca\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608319 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.608276    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608369 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.608334    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm4h\" (UniqueName: \"kubernetes.io/projected/34ab5457-0a74-451e-ad9f-fd24d906ea25-kube-api-access-gqm4h\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.608944 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.608666    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-serving-certs-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.609608 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.609572    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-metrics-client-ca\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.609885 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.609863    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-trusted-ca-bundle\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.610982 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.610957    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.611368 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.611344    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-federate-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.611444 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.611420    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-telemeter-client-tls\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.611490 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.611451    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34ab5457-0a74-451e-ad9f-fd24d906ea25-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.617715 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.617692    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqm4h\" (UniqueName: \"kubernetes.io/projected/34ab5457-0a74-451e-ad9f-fd24d906ea25-kube-api-access-gqm4h\") pod \"telemeter-client-778458fdf5-thjbs\" (UID: \"34ab5457-0a74-451e-ad9f-fd24d906ea25\") " pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:22.619925 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.619886    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c4bc4f75-lxkjj" podStartSLOduration=1.6198717230000002 podStartE2EDuration="1.619871723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:22.618478038 +0000 UTC m=+101.105401920" watchObservedRunningTime="2026-09-11 18:50:22.619871723 +0000 UTC m=+101.106795601"
Sep 11 18:50:22.638418 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.638380    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:50:22.641059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.641035    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dbd64bf5d-5w8tv"]
Sep 11 18:50:22.802107 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:22.802070    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs"
Sep 11 18:50:23.398185 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:23.398152    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-778458fdf5-thjbs"]
Sep 11 18:50:23.418522 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:23.418482    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ab5457_0a74_451e_ad9f_fd24d906ea25.slice/crio-321f9678f733dabab314790a48fa267b36fa6fd4bf2d1777d7a2830fb551208a WatchSource:0}: Error finding container 321f9678f733dabab314790a48fa267b36fa6fd4bf2d1777d7a2830fb551208a: Status 404 returned error can't find the container with id 321f9678f733dabab314790a48fa267b36fa6fd4bf2d1777d7a2830fb551208a
Sep 11 18:50:23.596514 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:23.596476    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs" event={"ID":"34ab5457-0a74-451e-ad9f-fd24d906ea25","Type":"ContainerStarted","Data":"321f9678f733dabab314790a48fa267b36fa6fd4bf2d1777d7a2830fb551208a"}
Sep 11 18:50:23.599693 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:23.599656    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"0de87e5dead4bee8dd0680eedcdb42f048bd022a66b3eaad86db86792ec2863c"}
Sep 11 18:50:23.995562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:23.995527    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f7761a-a30f-48f4-87d5-a32f22a9111b" path="/var/lib/kubelet/pods/a1f7761a-a30f-48f4-87d5-a32f22a9111b/volumes"
Sep 11 18:50:24.608908 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:24.608866    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"ef095620d147f7846fb507125a9aacbbcab62fdc698bcfe270cd7fbb0f181f67"}
Sep 11 18:50:24.609451 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:24.608959    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"b6778cde9b4ab8a0475cb1c0575db855456f7685d3ce5e1f23f572369a37d158"}
Sep 11 18:50:24.609451 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:24.608999    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"2ffe12a07f163497b354422ac12c64629a5ea0c4203ac5b63dc8f1b1d19376e7"}
Sep 11 18:50:24.609451 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:24.609036    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"f2d13cf77160189c1dd42b90454ab7c0706fd67a07b20fc1fb43be2bc7f867ad"}
Sep 11 18:50:26.619438 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.619403    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c70cbae5-bda0-408c-8f54-4fe8b3de8842","Type":"ContainerStarted","Data":"ce386242f0568d16be4a8a0d843d802c53b4e0b4193c30cdef38881639041a66"}
Sep 11 18:50:26.621478 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.621452    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs" event={"ID":"34ab5457-0a74-451e-ad9f-fd24d906ea25","Type":"ContainerStarted","Data":"935518a1ee2e4b4ae11437cef05fc44c9bc693269ce88bc80e11dd668872275b"}
Sep 11 18:50:26.621607 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.621497    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs" event={"ID":"34ab5457-0a74-451e-ad9f-fd24d906ea25","Type":"ContainerStarted","Data":"eaf3c1c3133d09856069d33d61a03a44696f2a7cc6e8d12f085755a3a9588276"}
Sep 11 18:50:26.621607 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.621518    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs" event={"ID":"34ab5457-0a74-451e-ad9f-fd24d906ea25","Type":"ContainerStarted","Data":"0462ec9225114e8c00a2471b68409ae8b0d0ae716efca5561b2511bb94fd8898"}
Sep 11 18:50:26.654623 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.654550    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.881411177 podStartE2EDuration="8.654529049s" totalImagesPullingTime="5.753986797s" totalInitContainerRuntime="19.131075ms" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:26.651685751 +0000 UTC m=+105.138609629" watchObservedRunningTime="2026-09-11 18:50:26.654529049 +0000 UTC m=+105.141452929"
Sep 11 18:50:26.681799 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.681741    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-778458fdf5-thjbs" podStartSLOduration=2.243425984 podStartE2EDuration="4.681720378s" totalImagesPullingTime="2.438294394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:26.680400738 +0000 UTC m=+105.167324618" watchObservedRunningTime="2026-09-11 18:50:26.681720378 +0000 UTC m=+105.168644258"
Sep 11 18:50:26.826163 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.826129    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:26.871802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.871716    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:50:26.895361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.895330    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:50:26.895562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.895447    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947692 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947651    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947704    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947753    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947787    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnt7\" (UniqueName: \"kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947822    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.947875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947855    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:26.948032 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:26.947882    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049318 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049281    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049328    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049345    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049367    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnt7\" (UniqueName: \"kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049395    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049427    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.049539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.049473    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.050218 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.050183    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.050312 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.050276    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.050368 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.050347    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.050675 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.050658    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.051998 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.051974    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.052122 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.052104    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.059527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.059504    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnt7\" (UniqueName: \"kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7\") pod \"console-657947f88c-gqw4n\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") " pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.204869 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.204839    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:27.502271 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.502192    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:50:27.505570 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:50:27.505521    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e99d096_d298_4697_88e4_4ff29cbc90b0.slice/crio-6dde6824f519f25fc117e3917aae703a0a4f2affa1be41c21cf321b674f139c8 WatchSource:0}: Error finding container 6dde6824f519f25fc117e3917aae703a0a4f2affa1be41c21cf321b674f139c8: Status 404 returned error can't find the container with id 6dde6824f519f25fc117e3917aae703a0a4f2affa1be41c21cf321b674f139c8
Sep 11 18:50:27.631651 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.630756    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657947f88c-gqw4n" event={"ID":"6e99d096-d298-4697-88e4-4ff29cbc90b0","Type":"ContainerStarted","Data":"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"}
Sep 11 18:50:27.631651 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.630828    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657947f88c-gqw4n" event={"ID":"6e99d096-d298-4697-88e4-4ff29cbc90b0","Type":"ContainerStarted","Data":"6dde6824f519f25fc117e3917aae703a0a4f2affa1be41c21cf321b674f139c8"}
Sep 11 18:50:27.659615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:27.659542    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657947f88c-gqw4n" podStartSLOduration=1.659522701 podStartE2EDuration="1.659522701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:50:27.658933138 +0000 UTC m=+106.145857019" watchObservedRunningTime="2026-09-11 18:50:27.659522701 +0000 UTC m=+106.146446582"
Sep 11 18:50:31.964616 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:31.964563    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:37.205100 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:37.205059    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:37.205517 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:37.205130    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:37.210238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:37.210212    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:37.677529 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:37.677501    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:50:37.784670 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:37.784633    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:50:39.577888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.577824    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b78df69d9-98x77" podUID="dc300ea5-3e1c-40fb-ae30-315d980f3795" containerName="console" containerID="cri-o://27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51" gracePeriod=15
Sep 11 18:50:39.819850 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.819826    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:39.968116 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968083    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968116 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968124    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvfj9\" (UniqueName: \"kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968196    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968232    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968289    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968314    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config\") pod \"dc300ea5-3e1c-40fb-ae30-315d980f3795\" (UID: \"dc300ea5-3e1c-40fb-ae30-315d980f3795\") "
Sep 11 18:50:39.968761 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968724    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:39.968894 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968752    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:39.968894 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.968774    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config" (OuterVolumeSpecName: "console-config") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:39.970443 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.970420    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:39.970527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.970444    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:39.970527 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:39.970484    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9" (OuterVolumeSpecName: "kube-api-access-gvfj9") pod "dc300ea5-3e1c-40fb-ae30-315d980f3795" (UID: "dc300ea5-3e1c-40fb-ae30-315d980f3795"). InnerVolumeSpecName "kube-api-access-gvfj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:40.069754 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069721    2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.069754 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069747    2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.069754 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069758    2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.069981 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069766    2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.069981 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069774    2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc300ea5-3e1c-40fb-ae30-315d980f3795-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.069981 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.069782    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvfj9\" (UniqueName: \"kubernetes.io/projected/dc300ea5-3e1c-40fb-ae30-315d980f3795-kube-api-access-gvfj9\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:40.691015 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.690975    2587 generic.go:356] "Generic (PLEG): container finished" podID="dc300ea5-3e1c-40fb-ae30-315d980f3795" containerID="27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51" exitCode=0
Sep 11 18:50:40.691392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.691025    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78df69d9-98x77"
Sep 11 18:50:40.691392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.691063    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78df69d9-98x77" event={"ID":"dc300ea5-3e1c-40fb-ae30-315d980f3795","Type":"ContainerDied","Data":"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"}
Sep 11 18:50:40.691392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.691116    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78df69d9-98x77" event={"ID":"dc300ea5-3e1c-40fb-ae30-315d980f3795","Type":"ContainerDied","Data":"832f9a2664f80843808906c94cfbbb7cf9faede797f2c1d11f1d6ffce3948a2c"}
Sep 11 18:50:40.691392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.691139    2587 scope.go:117] "RemoveContainer" containerID="27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"
Sep 11 18:50:40.699332 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.699311    2587 scope.go:117] "RemoveContainer" containerID="27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"
Sep 11 18:50:40.699621 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:50:40.699582    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51\": container with ID starting with 27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51 not found: ID does not exist" containerID="27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"
Sep 11 18:50:40.699724 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.699625    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51"} err="failed to get container status \"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51\": rpc error: code = NotFound desc = could not find container \"27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51\": container with ID starting with 27f878528671ec6225a1fe5ff31230a5e39fd248b472baebd42319344bfead51 not found: ID does not exist"
Sep 11 18:50:40.709745 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.709722    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:50:40.714319 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:40.714297    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b78df69d9-98x77"]
Sep 11 18:50:41.994390 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:41.994359    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc300ea5-3e1c-40fb-ae30-315d980f3795" path="/var/lib/kubelet/pods/dc300ea5-3e1c-40fb-ae30-315d980f3795/volumes"
Sep 11 18:50:46.070761 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:46.070683    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f86cdcc6-86wzz_420d2003-c7b3-489e-bf79-9f37ba6a0526/router/0.log"
Sep 11 18:50:46.083146 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:46.083118    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4wsk_3d65ea04-b065-4472-8239-bdf50ebbd480/serve-healthcheck-canary/0.log"
Sep 11 18:50:51.844948 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:51.844911    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c4bc4f75-lxkjj" podUID="4adb0cc6-9751-4276-8157-47fb9e13a359" containerName="console" containerID="cri-o://8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422" gracePeriod=15
Sep 11 18:50:52.134314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.134279    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:52.272854 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272817    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272882    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm4v7\" (UniqueName: \"kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272902    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272940    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272961    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.272988    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.273010    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config\") pod \"4adb0cc6-9751-4276-8157-47fb9e13a359\" (UID: \"4adb0cc6-9751-4276-8157-47fb9e13a359\") "
Sep 11 18:50:52.273489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.273456    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:52.273489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.273471    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:52.273668 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.273479    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca" (OuterVolumeSpecName: "service-ca") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:52.273668 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.273525    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config" (OuterVolumeSpecName: "console-config") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:50:52.275060 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.275037    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:52.275547 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.275526    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:50:52.275640 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.275543    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7" (OuterVolumeSpecName: "kube-api-access-zm4v7") pod "4adb0cc6-9751-4276-8157-47fb9e13a359" (UID: "4adb0cc6-9751-4276-8157-47fb9e13a359"). InnerVolumeSpecName "kube-api-access-zm4v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374522    2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374564    2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374577    2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374589    2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374623    2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4adb0cc6-9751-4276-8157-47fb9e13a359-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374635    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm4v7\" (UniqueName: \"kubernetes.io/projected/4adb0cc6-9751-4276-8157-47fb9e13a359-kube-api-access-zm4v7\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.374655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.374647    2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4adb0cc6-9751-4276-8157-47fb9e13a359-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:50:52.739130 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.739095    2587 generic.go:356] "Generic (PLEG): container finished" podID="4adb0cc6-9751-4276-8157-47fb9e13a359" containerID="8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422" exitCode=0
Sep 11 18:50:52.739294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.739153    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c4bc4f75-lxkjj" event={"ID":"4adb0cc6-9751-4276-8157-47fb9e13a359","Type":"ContainerDied","Data":"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"}
Sep 11 18:50:52.739294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.739165    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c4bc4f75-lxkjj"
Sep 11 18:50:52.739294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.739218    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c4bc4f75-lxkjj" event={"ID":"4adb0cc6-9751-4276-8157-47fb9e13a359","Type":"ContainerDied","Data":"5b0efb4506db3098899956364082dc9097a7fea511689495d8f9939da078bf33"}
Sep 11 18:50:52.739294 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.739238    2587 scope.go:117] "RemoveContainer" containerID="8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"
Sep 11 18:50:52.747798 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.747778    2587 scope.go:117] "RemoveContainer" containerID="8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"
Sep 11 18:50:52.748134 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:50:52.748110    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422\": container with ID starting with 8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422 not found: ID does not exist" containerID="8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"
Sep 11 18:50:52.748238 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.748143    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422"} err="failed to get container status \"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422\": rpc error: code = NotFound desc = could not find container \"8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422\": container with ID starting with 8ccbf673a9f88fca240fed19c830e2124d8f5f0820c8f767769b1b9847a3f422 not found: ID does not exist"
Sep 11 18:50:52.769332 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.769300    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:52.775417 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:52.775388    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c4bc4f75-lxkjj"]
Sep 11 18:50:53.994117 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:50:53.994082    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4adb0cc6-9751-4276-8157-47fb9e13a359" path="/var/lib/kubelet/pods/4adb0cc6-9751-4276-8157-47fb9e13a359/volumes"
Sep 11 18:51:02.804905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:02.804829    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5865bcd8dd-8vp94" podUID="5a7423e4-22a2-4d14-a114-818058d1a095" containerName="console" containerID="cri-o://aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b" gracePeriod=15
Sep 11 18:51:03.093055 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.093022    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:51:03.164959 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.164920    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.164959 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.164963    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165190 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165011    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165190 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165055    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165190 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165088    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165232    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq2tr\" (UniqueName: \"kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165293    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca\") pod \"5a7423e4-22a2-4d14-a114-818058d1a095\" (UID: \"5a7423e4-22a2-4d14-a114-818058d1a095\") "
Sep 11 18:51:03.165444 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165421    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:03.165509 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165463    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config" (OuterVolumeSpecName: "console-config") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:03.165509 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165466    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:03.165675 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165645    2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.165675 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165676    2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.165858 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165692    2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.165858 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.165760    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:51:03.167266 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.167236    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:51:03.167361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.167272    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:51:03.167361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.167331    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr" (OuterVolumeSpecName: "kube-api-access-zq2tr") pod "5a7423e4-22a2-4d14-a114-818058d1a095" (UID: "5a7423e4-22a2-4d14-a114-818058d1a095"). InnerVolumeSpecName "kube-api-access-zq2tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:51:03.266119 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.266081    2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a7423e4-22a2-4d14-a114-818058d1a095-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.266119 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.266116    2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.266119 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.266126    2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a7423e4-22a2-4d14-a114-818058d1a095-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.266382 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.266136    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq2tr\" (UniqueName: \"kubernetes.io/projected/5a7423e4-22a2-4d14-a114-818058d1a095-kube-api-access-zq2tr\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:51:03.789720 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.789688    2587 generic.go:356] "Generic (PLEG): container finished" podID="5a7423e4-22a2-4d14-a114-818058d1a095" containerID="aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b" exitCode=0
Sep 11 18:51:03.789898 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.789737    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5865bcd8dd-8vp94"
Sep 11 18:51:03.789898 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.789759    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865bcd8dd-8vp94" event={"ID":"5a7423e4-22a2-4d14-a114-818058d1a095","Type":"ContainerDied","Data":"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"}
Sep 11 18:51:03.789898 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.789800    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5865bcd8dd-8vp94" event={"ID":"5a7423e4-22a2-4d14-a114-818058d1a095","Type":"ContainerDied","Data":"3898a5007f4260d351508457a4a2f7936f89c7356ae5afad38918077aeae4e2c"}
Sep 11 18:51:03.789898 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.789825    2587 scope.go:117] "RemoveContainer" containerID="aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"
Sep 11 18:51:03.800195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.800172    2587 scope.go:117] "RemoveContainer" containerID="aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"
Sep 11 18:51:03.800541 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:51:03.800521    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b\": container with ID starting with aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b not found: ID does not exist" containerID="aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"
Sep 11 18:51:03.800635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.800551    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b"} err="failed to get container status \"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b\": rpc error: code = NotFound desc = could not find container \"aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b\": container with ID starting with aab7ddc99315a266e3dec59c0702877fcd21c0734485c61060d5b7e23b862f0b not found: ID does not exist"
Sep 11 18:51:03.812431 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.812401    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:51:03.816146 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.816120    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5865bcd8dd-8vp94"]
Sep 11 18:51:03.994345 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:03.994309    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7423e4-22a2-4d14-a114-818058d1a095" path="/var/lib/kubelet/pods/5a7423e4-22a2-4d14-a114-818058d1a095/volumes"
Sep 11 18:51:46.412332 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412294    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:51:46.412773 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412752    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc300ea5-3e1c-40fb-ae30-315d980f3795" containerName="console"
Sep 11 18:51:46.412818 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412778    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc300ea5-3e1c-40fb-ae30-315d980f3795" containerName="console"
Sep 11 18:51:46.412818 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412794    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7423e4-22a2-4d14-a114-818058d1a095" containerName="console"
Sep 11 18:51:46.412818 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412803    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7423e4-22a2-4d14-a114-818058d1a095" containerName="console"
Sep 11 18:51:46.412818 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412813    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adb0cc6-9751-4276-8157-47fb9e13a359" containerName="console"
Sep 11 18:51:46.412939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412824    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adb0cc6-9751-4276-8157-47fb9e13a359" containerName="console"
Sep 11 18:51:46.412939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412908    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc300ea5-3e1c-40fb-ae30-315d980f3795" containerName="console"
Sep 11 18:51:46.412939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412922    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adb0cc6-9751-4276-8157-47fb9e13a359" containerName="console"
Sep 11 18:51:46.412939 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.412933    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7423e4-22a2-4d14-a114-818058d1a095" containerName="console"
Sep 11 18:51:46.415447 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.415427    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.427269 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.427227    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:51:46.511489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511449    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511501    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511757 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511581    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511757 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511679    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511757 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511721    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511757 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511746    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.511906 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.511780    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqtx\" (UniqueName: \"kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612704 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612660    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqtx\" (UniqueName: \"kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612726    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612749    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612776    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612810    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612834    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.612907 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.612861    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.613560 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.613526    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.613560 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.613547    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.613728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.613536    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.613885 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.613859    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.615389 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.615367    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.615474 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.615408    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.620884 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.620856    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqtx\" (UniqueName: \"kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx\") pod \"console-cc97dd57c-jxtgn\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") " pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.724783 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.724740    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:46.995314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:46.995138    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:51:46.997418 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:51:46.997391    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce7d636_646d_4fed_9006_fff5a838ea98.slice/crio-69562a2fbb7e0dc78e72be33ef8b3eae4984f726775ffb76450721a65e42ebdc WatchSource:0}: Error finding container 69562a2fbb7e0dc78e72be33ef8b3eae4984f726775ffb76450721a65e42ebdc: Status 404 returned error can't find the container with id 69562a2fbb7e0dc78e72be33ef8b3eae4984f726775ffb76450721a65e42ebdc
Sep 11 18:51:47.958070 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:47.958028    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc97dd57c-jxtgn" event={"ID":"0ce7d636-646d-4fed-9006-fff5a838ea98","Type":"ContainerStarted","Data":"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"}
Sep 11 18:51:47.958515 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:47.958090    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc97dd57c-jxtgn" event={"ID":"0ce7d636-646d-4fed-9006-fff5a838ea98","Type":"ContainerStarted","Data":"69562a2fbb7e0dc78e72be33ef8b3eae4984f726775ffb76450721a65e42ebdc"}
Sep 11 18:51:47.983454 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:47.983401    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cc97dd57c-jxtgn" podStartSLOduration=1.983383747 podStartE2EDuration="1.983383747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:51:47.981820034 +0000 UTC m=+186.468743913" watchObservedRunningTime="2026-09-11 18:51:47.983383747 +0000 UTC m=+186.470307620"
Sep 11 18:51:56.725453 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:56.725395    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:56.725909 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:56.725481    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:56.730614 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:56.730575    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:56.997236 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:56.997158    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:51:57.040053 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:51:57.040019    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:52:21.363433 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.363398    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"]
Sep 11 18:52:21.365679 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.365660    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.368521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.368503    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sk69z\""
Sep 11 18:52:21.368829 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.368808    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:52:21.368967 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.368833    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:52:21.378537 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.378504    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"]
Sep 11 18:52:21.410060 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.410019    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.410235 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.410074    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.410235 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.410155    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzgp\" (UniqueName: \"kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.511073 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.511037    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.511295 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.511111    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stzgp\" (UniqueName: \"kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.511295 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.511167    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.511539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.511512    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.511539 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.511529    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.520348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.520318    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzgp\" (UniqueName: \"kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.675159 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.675134    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:21.960849 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:21.960818    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"]
Sep 11 18:52:21.963562 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:52:21.963531    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fde9ae_ab13_4f24_8b8f_888a653648eb.slice/crio-029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d WatchSource:0}: Error finding container 029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d: Status 404 returned error can't find the container with id 029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d
Sep 11 18:52:22.061385 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.061321    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657947f88c-gqw4n" podUID="6e99d096-d298-4697-88e4-4ff29cbc90b0" containerName="console" containerID="cri-o://bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967" gracePeriod=15
Sep 11 18:52:22.087962 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.087929    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerStarted","Data":"029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d"}
Sep 11 18:52:22.298379 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.298355    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:52:22.318866 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.318834    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.318886    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.318920    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.318952    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319016    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319258 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319045    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319258 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319078    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxnt7\" (UniqueName: \"kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7\") pod \"6e99d096-d298-4697-88e4-4ff29cbc90b0\" (UID: \"6e99d096-d298-4697-88e4-4ff29cbc90b0\") "
Sep 11 18:52:22.319627 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319561    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:52:22.319856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319829    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config" (OuterVolumeSpecName: "console-config") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:52:22.320027 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.319985    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:52:22.320138 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.320114    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:52:22.321975 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.321944    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:52:22.321975 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.321961    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7" (OuterVolumeSpecName: "kube-api-access-fxnt7") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "kube-api-access-fxnt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:22.322106 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.321971    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e99d096-d298-4697-88e4-4ff29cbc90b0" (UID: "6e99d096-d298-4697-88e4-4ff29cbc90b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:52:22.420325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420288    2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420316    2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420326    2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420335    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxnt7\" (UniqueName: \"kubernetes.io/projected/6e99d096-d298-4697-88e4-4ff29cbc90b0-kube-api-access-fxnt7\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420811 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420344    2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e99d096-d298-4697-88e4-4ff29cbc90b0-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420811 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420354    2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:22.420811 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:22.420362    2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e99d096-d298-4697-88e4-4ff29cbc90b0-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:23.093569 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.093528    2587 generic.go:356] "Generic (PLEG): container finished" podID="6e99d096-d298-4697-88e4-4ff29cbc90b0" containerID="bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967" exitCode=0
Sep 11 18:52:23.093776 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.093604    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657947f88c-gqw4n"
Sep 11 18:52:23.093776 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.093609    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657947f88c-gqw4n" event={"ID":"6e99d096-d298-4697-88e4-4ff29cbc90b0","Type":"ContainerDied","Data":"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"}
Sep 11 18:52:23.093776 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.093671    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657947f88c-gqw4n" event={"ID":"6e99d096-d298-4697-88e4-4ff29cbc90b0","Type":"ContainerDied","Data":"6dde6824f519f25fc117e3917aae703a0a4f2affa1be41c21cf321b674f139c8"}
Sep 11 18:52:23.093776 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.093701    2587 scope.go:117] "RemoveContainer" containerID="bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"
Sep 11 18:52:23.105469 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.105444    2587 scope.go:117] "RemoveContainer" containerID="bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"
Sep 11 18:52:23.105880 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:52:23.105858    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967\": container with ID starting with bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967 not found: ID does not exist" containerID="bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"
Sep 11 18:52:23.105981 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.105888    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967"} err="failed to get container status \"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967\": rpc error: code = NotFound desc = could not find container \"bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967\": container with ID starting with bab01c112c83262f43432d39a5a7a627475190ee417dee760f1c6ebe76fb4967 not found: ID does not exist"
Sep 11 18:52:23.117471 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.117441    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:52:23.123866 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.123833    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657947f88c-gqw4n"]
Sep 11 18:52:23.995796 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:23.995763    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e99d096-d298-4697-88e4-4ff29cbc90b0" path="/var/lib/kubelet/pods/6e99d096-d298-4697-88e4-4ff29cbc90b0/volumes"
Sep 11 18:52:28.117095 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:28.117055    2587 generic.go:356] "Generic (PLEG): container finished" podID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerID="d3c72b8113d23c67638743eb53b51fbfbc4a8d1f465047cef94ec14924d04ec8" exitCode=0
Sep 11 18:52:28.117511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:28.117116    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerDied","Data":"d3c72b8113d23c67638743eb53b51fbfbc4a8d1f465047cef94ec14924d04ec8"}
Sep 11 18:52:30.130006 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:30.129971    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerStarted","Data":"6df519162e22f1c52c85f86bf7218e2b3ac6401ca83d0efd220a1ff7f903f4bf"}
Sep 11 18:52:31.136371 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:31.136331    2587 generic.go:356] "Generic (PLEG): container finished" podID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerID="6df519162e22f1c52c85f86bf7218e2b3ac6401ca83d0efd220a1ff7f903f4bf" exitCode=0
Sep 11 18:52:31.136873 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:31.136417    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerDied","Data":"6df519162e22f1c52c85f86bf7218e2b3ac6401ca83d0efd220a1ff7f903f4bf"}
Sep 11 18:52:38.167619 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:38.167565    2587 generic.go:356] "Generic (PLEG): container finished" podID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerID="323bb9f0f9602e503d4ee17f9aced3025f3ef9a0da6a265196e7c3d51298239d" exitCode=0
Sep 11 18:52:38.168009 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:38.167651    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerDied","Data":"323bb9f0f9602e503d4ee17f9aced3025f3ef9a0da6a265196e7c3d51298239d"}
Sep 11 18:52:39.296455 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.296429    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:39.367301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.367265    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle\") pod \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") "
Sep 11 18:52:39.367301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.367305    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util\") pod \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") "
Sep 11 18:52:39.367630 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.367385    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stzgp\" (UniqueName: \"kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp\") pod \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\" (UID: \"f9fde9ae-ab13-4f24-8b8f-888a653648eb\") "
Sep 11 18:52:39.367996 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.367972    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle" (OuterVolumeSpecName: "bundle") pod "f9fde9ae-ab13-4f24-8b8f-888a653648eb" (UID: "f9fde9ae-ab13-4f24-8b8f-888a653648eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:39.369627 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.369602    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp" (OuterVolumeSpecName: "kube-api-access-stzgp") pod "f9fde9ae-ab13-4f24-8b8f-888a653648eb" (UID: "f9fde9ae-ab13-4f24-8b8f-888a653648eb"). InnerVolumeSpecName "kube-api-access-stzgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:39.372313 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.372288    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util" (OuterVolumeSpecName: "util") pod "f9fde9ae-ab13-4f24-8b8f-888a653648eb" (UID: "f9fde9ae-ab13-4f24-8b8f-888a653648eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:39.468859 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.468814    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:39.468859 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.468862    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9fde9ae-ab13-4f24-8b8f-888a653648eb-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:39.469058 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:39.468871    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stzgp\" (UniqueName: \"kubernetes.io/projected/f9fde9ae-ab13-4f24-8b8f-888a653648eb-kube-api-access-stzgp\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:40.176676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:40.176648    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7"
Sep 11 18:52:40.176832 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:40.176638    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fd7m7" event={"ID":"f9fde9ae-ab13-4f24-8b8f-888a653648eb","Type":"ContainerDied","Data":"029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d"}
Sep 11 18:52:40.176832 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:40.176773    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="029d45067f9027675378ea63904806d2565b59334a9f037ae3de65ed19b7124d"
Sep 11 18:52:45.309067 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309031    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"]
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309336    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e99d096-d298-4697-88e4-4ff29cbc90b0" containerName="console"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309346    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e99d096-d298-4697-88e4-4ff29cbc90b0" containerName="console"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309360    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="util"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309368    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="util"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309379    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="pull"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309388    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="pull"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309408    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="extract"
Sep 11 18:52:45.309441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309414    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="extract"
Sep 11 18:52:45.309702 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309457    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e99d096-d298-4697-88e4-4ff29cbc90b0" containerName="console"
Sep 11 18:52:45.309702 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.309465    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fde9ae-ab13-4f24-8b8f-888a653648eb" containerName="extract"
Sep 11 18:52:45.314041 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.314020    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.316635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.316588    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 18:52:45.316782 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.316659    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 18:52:45.316782 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.316695    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d5b79\""
Sep 11 18:52:45.337720 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.337691    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"]
Sep 11 18:52:45.415818 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.415782    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0403181e-a809-496f-8503-b11d879c4ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.415987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.415896    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7gs8\" (UniqueName: \"kubernetes.io/projected/0403181e-a809-496f-8503-b11d879c4ae6-kube-api-access-t7gs8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.517196 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.517159    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0403181e-a809-496f-8503-b11d879c4ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.517373 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.517237    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7gs8\" (UniqueName: \"kubernetes.io/projected/0403181e-a809-496f-8503-b11d879c4ae6-kube-api-access-t7gs8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.517565 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.517547    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0403181e-a809-496f-8503-b11d879c4ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.533288 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.533262    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7gs8\" (UniqueName: \"kubernetes.io/projected/0403181e-a809-496f-8503-b11d879c4ae6-kube-api-access-t7gs8\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqsl6\" (UID: \"0403181e-a809-496f-8503-b11d879c4ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.623057 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.622960    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"
Sep 11 18:52:45.901275 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:45.901206    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6"]
Sep 11 18:52:45.903536 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:52:45.903509    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0403181e_a809_496f_8503_b11d879c4ae6.slice/crio-197d67d2eda8abfd10636da53499446da007e7e42001459d660de9471a1e3bc9 WatchSource:0}: Error finding container 197d67d2eda8abfd10636da53499446da007e7e42001459d660de9471a1e3bc9: Status 404 returned error can't find the container with id 197d67d2eda8abfd10636da53499446da007e7e42001459d660de9471a1e3bc9
Sep 11 18:52:46.201032 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:46.200999    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6" event={"ID":"0403181e-a809-496f-8503-b11d879c4ae6","Type":"ContainerStarted","Data":"197d67d2eda8abfd10636da53499446da007e7e42001459d660de9471a1e3bc9"}
Sep 11 18:52:48.213894 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.213848    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6" event={"ID":"0403181e-a809-496f-8503-b11d879c4ae6","Type":"ContainerStarted","Data":"8dd0ccad5e69a387490c39b2def77e0fd91d38e16a6b965ab4f3ef80a19269ae"}
Sep 11 18:52:48.242948 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.242892    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqsl6" podStartSLOduration=1.590479299 podStartE2EDuration="3.242871677s" totalImagesPullingTime="1.652392378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:52:48.242606665 +0000 UTC m=+246.729530537" watchObservedRunningTime="2026-09-11 18:52:48.242871677 +0000 UTC m=+246.729795556"
Sep 11 18:52:48.899643 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.899589    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"]
Sep 11 18:52:48.903023 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.903005    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:48.905728 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.905703    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:52:48.905991 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.905973    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:52:48.907036 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.907014    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sk69z\""
Sep 11 18:52:48.936817 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:48.936784    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"]
Sep 11 18:52:49.045304 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.045268    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.045510 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.045320    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfvbw\" (UniqueName: \"kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.045510 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.045385    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.146445 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.146405    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.146652 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.146457    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfvbw\" (UniqueName: \"kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.146652 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.146501    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.146886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.146865    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.146931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.146883    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.164569 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.164501    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfvbw\" (UniqueName: \"kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.212418 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.212381    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:49.521691 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.521654    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"]
Sep 11 18:52:49.524728 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:52:49.524692    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced7c9c4_cada_4e87_ab24_81bc996b2f16.slice/crio-5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f WatchSource:0}: Error finding container 5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f: Status 404 returned error can't find the container with id 5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f
Sep 11 18:52:49.744220 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.744176    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tkm75"]
Sep 11 18:52:49.747380 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.747357    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.750245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.750217    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 18:52:49.750556 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.750539    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gxvn8\""
Sep 11 18:52:49.750677 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.750542    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 18:52:49.760977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.760949    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tkm75"]
Sep 11 18:52:49.852079 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.851974    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gtb\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-kube-api-access-m7gtb\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.852273 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.852121    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.952850 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.952804    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gtb\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-kube-api-access-m7gtb\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.953018 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.952893    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.961507 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.961471    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:49.961740 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:49.961722    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gtb\" (UniqueName: \"kubernetes.io/projected/ea202c33-4e1d-41d7-a695-caa679de5ebd-kube-api-access-m7gtb\") pod \"cert-manager-webhook-6486ffd997-tkm75\" (UID: \"ea202c33-4e1d-41d7-a695-caa679de5ebd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:50.065554 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:50.065498    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:50.224528 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:50.224493    2587 generic.go:356] "Generic (PLEG): container finished" podID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerID="6014e176859802c3f5b2a434f5cc784a12a2d684e97c50eac0fff088f5f75df5" exitCode=0
Sep 11 18:52:50.224705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:50.224526    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz" event={"ID":"ced7c9c4-cada-4e87-ab24-81bc996b2f16","Type":"ContainerDied","Data":"6014e176859802c3f5b2a434f5cc784a12a2d684e97c50eac0fff088f5f75df5"}
Sep 11 18:52:50.224705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:50.224579    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz" event={"ID":"ced7c9c4-cada-4e87-ab24-81bc996b2f16","Type":"ContainerStarted","Data":"5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f"}
Sep 11 18:52:50.381427 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:50.381340    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tkm75"]
Sep 11 18:52:50.384472 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:52:50.384448    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea202c33_4e1d_41d7_a695_caa679de5ebd.slice/crio-1271f24b68d8d18253f5aa88a471308cff0812671bf7f39ce3f35c1884a4f8d6 WatchSource:0}: Error finding container 1271f24b68d8d18253f5aa88a471308cff0812671bf7f39ce3f35c1884a4f8d6: Status 404 returned error can't find the container with id 1271f24b68d8d18253f5aa88a471308cff0812671bf7f39ce3f35c1884a4f8d6
Sep 11 18:52:51.231516 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:51.231474    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75" event={"ID":"ea202c33-4e1d-41d7-a695-caa679de5ebd","Type":"ContainerStarted","Data":"1271f24b68d8d18253f5aa88a471308cff0812671bf7f39ce3f35c1884a4f8d6"}
Sep 11 18:52:52.090314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.090248    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"]
Sep 11 18:52:52.099357 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.099322    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.102007 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.101776    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hv7vc\""
Sep 11 18:52:52.103921 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.103891    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"]
Sep 11 18:52:52.271635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.271570    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9br4\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-kube-api-access-c9br4\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.272059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.271753    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.373253 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.373169    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9br4\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-kube-api-access-c9br4\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.373405 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.373267    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.387069 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.387034    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.387254 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.387186    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9br4\" (UniqueName: \"kubernetes.io/projected/3dc4cf32-aa99-49b1-b6b9-b4ea7a553316-kube-api-access-c9br4\") pod \"cert-manager-cainjector-559cdd8c87-vnzlg\" (UID: \"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:52.412126 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:52.412090    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"
Sep 11 18:52:53.786342 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:53.786313    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg"]
Sep 11 18:52:53.787926 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:52:53.787898    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc4cf32_aa99_49b1_b6b9_b4ea7a553316.slice/crio-29dfc70274ff6714e77f178214fbacac649a0aa3a0c4c13bcc8b1fc032adcde0 WatchSource:0}: Error finding container 29dfc70274ff6714e77f178214fbacac649a0aa3a0c4c13bcc8b1fc032adcde0: Status 404 returned error can't find the container with id 29dfc70274ff6714e77f178214fbacac649a0aa3a0c4c13bcc8b1fc032adcde0
Sep 11 18:52:54.247767 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.247737    2587 generic.go:356] "Generic (PLEG): container finished" podID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerID="4b1b9502b379bfbe804b00404f096f1389319a72de8bfa4fd4196de0f4a65546" exitCode=0
Sep 11 18:52:54.247966 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.247827    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz" event={"ID":"ced7c9c4-cada-4e87-ab24-81bc996b2f16","Type":"ContainerDied","Data":"4b1b9502b379bfbe804b00404f096f1389319a72de8bfa4fd4196de0f4a65546"}
Sep 11 18:52:54.249581 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.249556    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75" event={"ID":"ea202c33-4e1d-41d7-a695-caa679de5ebd","Type":"ContainerStarted","Data":"807d698d6264ef1ee56ea9e5449a1622b2c772532fb97f1fffe1577239f1d4ec"}
Sep 11 18:52:54.249693 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.249639    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:52:54.251219 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.251197    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg" event={"ID":"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316","Type":"ContainerStarted","Data":"2b9f81ac9cffa12c427a01f4e2a13ddb4f6c227df2d0dd2597839aa9a21f27a1"}
Sep 11 18:52:54.251329 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.251225    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg" event={"ID":"3dc4cf32-aa99-49b1-b6b9-b4ea7a553316","Type":"ContainerStarted","Data":"29dfc70274ff6714e77f178214fbacac649a0aa3a0c4c13bcc8b1fc032adcde0"}
Sep 11 18:52:54.282129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.282078    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vnzlg" podStartSLOduration=2.282056194 podStartE2EDuration="2.282056194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:52:54.281117091 +0000 UTC m=+252.768040969" watchObservedRunningTime="2026-09-11 18:52:54.282056194 +0000 UTC m=+252.768980073"
Sep 11 18:52:54.299435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:54.299385    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75" podStartSLOduration=2.181815973 podStartE2EDuration="5.299369037s" totalImagesPullingTime="3.117553064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:52:54.29733682 +0000 UTC m=+252.784260710" watchObservedRunningTime="2026-09-11 18:52:54.299369037 +0000 UTC m=+252.786292916"
Sep 11 18:52:55.258202 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:55.258165    2587 generic.go:356] "Generic (PLEG): container finished" podID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerID="01851284bbb7fe029c95e3b95c8a1a33864c927ed197d23df671ed3ae3d80b3d" exitCode=0
Sep 11 18:52:55.258585 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:55.258248    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz" event={"ID":"ced7c9c4-cada-4e87-ab24-81bc996b2f16","Type":"ContainerDied","Data":"01851284bbb7fe029c95e3b95c8a1a33864c927ed197d23df671ed3ae3d80b3d"}
Sep 11 18:52:56.390052 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.390019    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:56.513854 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.513757    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle\") pod \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") "
Sep 11 18:52:56.513854 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.513852    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfvbw\" (UniqueName: \"kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw\") pod \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") "
Sep 11 18:52:56.514038 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.513897    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util\") pod \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\" (UID: \"ced7c9c4-cada-4e87-ab24-81bc996b2f16\") "
Sep 11 18:52:56.514293 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.514269    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle" (OuterVolumeSpecName: "bundle") pod "ced7c9c4-cada-4e87-ab24-81bc996b2f16" (UID: "ced7c9c4-cada-4e87-ab24-81bc996b2f16"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:56.516027 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.516001    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw" (OuterVolumeSpecName: "kube-api-access-kfvbw") pod "ced7c9c4-cada-4e87-ab24-81bc996b2f16" (UID: "ced7c9c4-cada-4e87-ab24-81bc996b2f16"). InnerVolumeSpecName "kube-api-access-kfvbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:52:56.518898 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.518877    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util" (OuterVolumeSpecName: "util") pod "ced7c9c4-cada-4e87-ab24-81bc996b2f16" (UID: "ced7c9c4-cada-4e87-ab24-81bc996b2f16"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:52:56.614474 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.614420    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:56.614676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.614491    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ced7c9c4-cada-4e87-ab24-81bc996b2f16-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:56.614676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:56.614506    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfvbw\" (UniqueName: \"kubernetes.io/projected/ced7c9c4-cada-4e87-ab24-81bc996b2f16-kube-api-access-kfvbw\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:52:57.268215 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:57.268180    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz" event={"ID":"ced7c9c4-cada-4e87-ab24-81bc996b2f16","Type":"ContainerDied","Data":"5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f"}
Sep 11 18:52:57.268426 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:57.268222    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjg7wz"
Sep 11 18:52:57.268426 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:52:57.268228    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dfc3418da4200788a5a8ad84b930c42318cb973b1f4545585e0fddb4f8acd3f"
Sep 11 18:53:00.260695 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:00.260663    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tkm75"
Sep 11 18:53:06.705349 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705266    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"]
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705642    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="util"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705658    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="util"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705667    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="extract"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705672    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="extract"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705683    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="pull"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705688    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="pull"
Sep 11 18:53:06.705736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.705739    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced7c9c4-cada-4e87-ab24-81bc996b2f16" containerName="extract"
Sep 11 18:53:06.730154 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.730123    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"]
Sep 11 18:53:06.730322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.730239    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.732791 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.732769    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sk69z\""
Sep 11 18:53:06.733050 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.733034    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:53:06.733309 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.733291    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:53:06.795613 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.795566    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.795804 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.795649    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnvvf\" (UniqueName: \"kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.795804 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.795681    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.896085 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.896045    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.896261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.896121    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.896261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.896142    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnvvf\" (UniqueName: \"kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.896450 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.896431    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.896519 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.896499    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:06.905615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:06.905569    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnvvf\" (UniqueName: \"kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:07.039969 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:07.039873    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:07.357786 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:07.357755    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"]
Sep 11 18:53:07.360494 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:53:07.360458    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb560100_49f2_4b62_96dd_30aeca54b134.slice/crio-ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0 WatchSource:0}: Error finding container ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0: Status 404 returned error can't find the container with id ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0
Sep 11 18:53:08.314335 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:08.314303    2587 generic.go:356] "Generic (PLEG): container finished" podID="eb560100-49f2-4b62-96dd-30aeca54b134" containerID="b1be7081380fb7df3e77b0c6d3c968df111f05d3953c0a4afe1a38d03007b9a8" exitCode=0
Sep 11 18:53:08.314802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:08.314398    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt" event={"ID":"eb560100-49f2-4b62-96dd-30aeca54b134","Type":"ContainerDied","Data":"b1be7081380fb7df3e77b0c6d3c968df111f05d3953c0a4afe1a38d03007b9a8"}
Sep 11 18:53:08.314802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:08.314450    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt" event={"ID":"eb560100-49f2-4b62-96dd-30aeca54b134","Type":"ContainerStarted","Data":"ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0"}
Sep 11 18:53:10.324307 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:10.324269    2587 generic.go:356] "Generic (PLEG): container finished" podID="eb560100-49f2-4b62-96dd-30aeca54b134" containerID="009d24f4e545f7ac754799946dc893e8ce6a99f70ac09d1d7236a0746904d49d" exitCode=0
Sep 11 18:53:10.324698 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:10.324348    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt" event={"ID":"eb560100-49f2-4b62-96dd-30aeca54b134","Type":"ContainerDied","Data":"009d24f4e545f7ac754799946dc893e8ce6a99f70ac09d1d7236a0746904d49d"}
Sep 11 18:53:11.331014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:11.330976    2587 generic.go:356] "Generic (PLEG): container finished" podID="eb560100-49f2-4b62-96dd-30aeca54b134" containerID="920f290197dff82abae6882e47e53a3cb4bf7b8df2b9ca6350e9cb9c2c313a06" exitCode=0
Sep 11 18:53:11.331420 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:11.331062    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt" event={"ID":"eb560100-49f2-4b62-96dd-30aeca54b134","Type":"ContainerDied","Data":"920f290197dff82abae6882e47e53a3cb4bf7b8df2b9ca6350e9cb9c2c313a06"}
Sep 11 18:53:12.468489 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.468459    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:12.535038 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.535001    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnvvf\" (UniqueName: \"kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf\") pod \"eb560100-49f2-4b62-96dd-30aeca54b134\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") "
Sep 11 18:53:12.535231 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.535077    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util\") pod \"eb560100-49f2-4b62-96dd-30aeca54b134\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") "
Sep 11 18:53:12.535231 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.535117    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle\") pod \"eb560100-49f2-4b62-96dd-30aeca54b134\" (UID: \"eb560100-49f2-4b62-96dd-30aeca54b134\") "
Sep 11 18:53:12.535896 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.535868    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle" (OuterVolumeSpecName: "bundle") pod "eb560100-49f2-4b62-96dd-30aeca54b134" (UID: "eb560100-49f2-4b62-96dd-30aeca54b134"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:53:12.537192 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.537173    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf" (OuterVolumeSpecName: "kube-api-access-mnvvf") pod "eb560100-49f2-4b62-96dd-30aeca54b134" (UID: "eb560100-49f2-4b62-96dd-30aeca54b134"). InnerVolumeSpecName "kube-api-access-mnvvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:53:12.541085 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.541046    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util" (OuterVolumeSpecName: "util") pod "eb560100-49f2-4b62-96dd-30aeca54b134" (UID: "eb560100-49f2-4b62-96dd-30aeca54b134"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:53:12.635734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.635637    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:12.635734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.635681    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnvvf\" (UniqueName: \"kubernetes.io/projected/eb560100-49f2-4b62-96dd-30aeca54b134-kube-api-access-mnvvf\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:12.635734 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:12.635692    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb560100-49f2-4b62-96dd-30aeca54b134-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:13.342319 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:13.342269    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt" event={"ID":"eb560100-49f2-4b62-96dd-30aeca54b134","Type":"ContainerDied","Data":"ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0"}
Sep 11 18:53:13.342319 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:13.342309    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcmjnt"
Sep 11 18:53:13.342521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:13.342362    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae260a2e5f0c55434d5d6174ecefda46ae12c40c3444a054cd9faf5cf12a15c0"
Sep 11 18:53:21.495223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495165    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"]
Sep 11 18:53:21.495885 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495863    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="pull"
Sep 11 18:53:21.495958 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495889    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="pull"
Sep 11 18:53:21.495958 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495923    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="util"
Sep 11 18:53:21.495958 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495931    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="util"
Sep 11 18:53:21.495958 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495948    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="extract"
Sep 11 18:53:21.495958 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.495958    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="extract"
Sep 11 18:53:21.496180 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.496094    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb560100-49f2-4b62-96dd-30aeca54b134" containerName="extract"
Sep 11 18:53:21.503280 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.503257    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.508201 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.508171    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:53:21.509062 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.509041    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sk69z\""
Sep 11 18:53:21.509169 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.509060    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:53:21.511524 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.511499    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"]
Sep 11 18:53:21.598275 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.598237    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.598450 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.598326    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxxb\" (UniqueName: \"kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.598450 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.598363    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.699706 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.699665    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.699899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.699715    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.699899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.699785    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxxb\" (UniqueName: \"kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.700166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.700143    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.700239 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.700150    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.729671 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.729639    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxxb\" (UniqueName: \"kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:21.813095 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:21.813010    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:22.091370 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:22.091285    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"]
Sep 11 18:53:22.094261 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:53:22.094225    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4551b7_a587_460c_a95a_ba1970666f33.slice/crio-e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de WatchSource:0}: Error finding container e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de: Status 404 returned error can't find the container with id e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de
Sep 11 18:53:22.383305 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:22.383211    2587 generic.go:356] "Generic (PLEG): container finished" podID="0b4551b7-a587-460c-a95a-ba1970666f33" containerID="e084d5a271e823a714212deb6641ff20d5c67626e49fc5e14892e61d70ccab47" exitCode=0
Sep 11 18:53:22.383305 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:22.383264    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5" event={"ID":"0b4551b7-a587-460c-a95a-ba1970666f33","Type":"ContainerDied","Data":"e084d5a271e823a714212deb6641ff20d5c67626e49fc5e14892e61d70ccab47"}
Sep 11 18:53:22.383305 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:22.383304    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5" event={"ID":"0b4551b7-a587-460c-a95a-ba1970666f33","Type":"ContainerStarted","Data":"e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de"}
Sep 11 18:53:23.390010 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.389974    2587 generic.go:356] "Generic (PLEG): container finished" podID="0b4551b7-a587-460c-a95a-ba1970666f33" containerID="ace45052162b0c9310d039936d764b02f4ce96b6bc47d131627671b6c8158797" exitCode=0
Sep 11 18:53:23.390404 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.390024    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5" event={"ID":"0b4551b7-a587-460c-a95a-ba1970666f33","Type":"ContainerDied","Data":"ace45052162b0c9310d039936d764b02f4ce96b6bc47d131627671b6c8158797"}
Sep 11 18:53:23.428442 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.428412    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"]
Sep 11 18:53:23.432971 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.432951    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.437295 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.437276    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 18:53:23.437534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.437517    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 18:53:23.437634 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.437614    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 18:53:23.437704 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.437652    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-snlds\""
Sep 11 18:53:23.438090 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.438069    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 18:53:23.453417 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.453372    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"]
Sep 11 18:53:23.515338 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.515298    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-tmp\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.515610 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.515571    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g46k\" (UniqueName: \"kubernetes.io/projected/c94907e8-54c5-442e-9337-30955a260d11-kube-api-access-8g46k\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.515783 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.515755    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.515892 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.515818    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.515932 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.515904    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-manifests\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.616949 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.616916    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.617142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.616964    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.617142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.617006    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-manifests\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.617142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.617040    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-tmp\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.617142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.617072    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g46k\" (UniqueName: \"kubernetes.io/projected/c94907e8-54c5-442e-9337-30955a260d11-kube-api-access-8g46k\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.617491 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.617457    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-manifests\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.619388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.619355    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94907e8-54c5-442e-9337-30955a260d11-tmp\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.619471 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.619444    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.619537 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.619522    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c94907e8-54c5-442e-9337-30955a260d11-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.638998 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.638977    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g46k\" (UniqueName: \"kubernetes.io/projected/c94907e8-54c5-442e-9337-30955a260d11-kube-api-access-8g46k\") pod \"opendatahub-operator-controller-manager-c9988978f-ln6j9\" (UID: \"c94907e8-54c5-442e-9337-30955a260d11\") " pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:23.743615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:23.743558    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:24.028868 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:24.028843    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"]
Sep 11 18:53:24.030745 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:53:24.030713    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94907e8_54c5_442e_9337_30955a260d11.slice/crio-31aa0a99828ae9d444ed00c5b287110737750735aabcd74a35d7374d8f69788c WatchSource:0}: Error finding container 31aa0a99828ae9d444ed00c5b287110737750735aabcd74a35d7374d8f69788c: Status 404 returned error can't find the container with id 31aa0a99828ae9d444ed00c5b287110737750735aabcd74a35d7374d8f69788c
Sep 11 18:53:24.396167 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:24.396074    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9" event={"ID":"c94907e8-54c5-442e-9337-30955a260d11","Type":"ContainerStarted","Data":"31aa0a99828ae9d444ed00c5b287110737750735aabcd74a35d7374d8f69788c"}
Sep 11 18:53:24.398116 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:24.398093    2587 generic.go:356] "Generic (PLEG): container finished" podID="0b4551b7-a587-460c-a95a-ba1970666f33" containerID="6c0fb4f32ef3cb2cdd29fc4fa9a81cf9d6e35ee21911043fd9ae255ed7bbadcc" exitCode=0
Sep 11 18:53:24.398199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:24.398140    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5" event={"ID":"0b4551b7-a587-460c-a95a-ba1970666f33","Type":"ContainerDied","Data":"6c0fb4f32ef3cb2cdd29fc4fa9a81cf9d6e35ee21911043fd9ae255ed7bbadcc"}
Sep 11 18:53:25.550654 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.550621    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:25.635609 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.635562    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util\") pod \"0b4551b7-a587-460c-a95a-ba1970666f33\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") "
Sep 11 18:53:25.635787 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.635672    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krxxb\" (UniqueName: \"kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb\") pod \"0b4551b7-a587-460c-a95a-ba1970666f33\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") "
Sep 11 18:53:25.635787 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.635738    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle\") pod \"0b4551b7-a587-460c-a95a-ba1970666f33\" (UID: \"0b4551b7-a587-460c-a95a-ba1970666f33\") "
Sep 11 18:53:25.636645 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.636589    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle" (OuterVolumeSpecName: "bundle") pod "0b4551b7-a587-460c-a95a-ba1970666f33" (UID: "0b4551b7-a587-460c-a95a-ba1970666f33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:53:25.638164 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.638126    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb" (OuterVolumeSpecName: "kube-api-access-krxxb") pod "0b4551b7-a587-460c-a95a-ba1970666f33" (UID: "0b4551b7-a587-460c-a95a-ba1970666f33"). InnerVolumeSpecName "kube-api-access-krxxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:53:25.642357 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.642310    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util" (OuterVolumeSpecName: "util") pod "0b4551b7-a587-460c-a95a-ba1970666f33" (UID: "0b4551b7-a587-460c-a95a-ba1970666f33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:53:25.737124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.737088    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krxxb\" (UniqueName: \"kubernetes.io/projected/0b4551b7-a587-460c-a95a-ba1970666f33-kube-api-access-krxxb\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:25.737124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.737120    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:25.737124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:25.737131    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b4551b7-a587-460c-a95a-ba1970666f33-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:53:26.411555 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:26.411469    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5"
Sep 11 18:53:26.411555 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:26.411475    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d9lj5" event={"ID":"0b4551b7-a587-460c-a95a-ba1970666f33","Type":"ContainerDied","Data":"e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de"}
Sep 11 18:53:26.411555 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:26.411541    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e89bfdadcdbf4cc13216d6765cacec758be63c5dd1fd6e1cc4cf5a973ab954de"
Sep 11 18:53:27.417255 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:27.417222    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9" event={"ID":"c94907e8-54c5-442e-9337-30955a260d11","Type":"ContainerStarted","Data":"f7b169a4be1420fd4421bc1a21b654a8b52f6e0e3328bab5d1cc6ce838daeb44"}
Sep 11 18:53:28.423736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:28.423699    2587 generic.go:356] "Generic (PLEG): container finished" podID="c94907e8-54c5-442e-9337-30955a260d11" containerID="f7b169a4be1420fd4421bc1a21b654a8b52f6e0e3328bab5d1cc6ce838daeb44" exitCode=0
Sep 11 18:53:28.424194 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:28.423763    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9" event={"ID":"c94907e8-54c5-442e-9337-30955a260d11","Type":"ContainerDied","Data":"f7b169a4be1420fd4421bc1a21b654a8b52f6e0e3328bab5d1cc6ce838daeb44"}
Sep 11 18:53:29.430946 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:29.430900    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9" event={"ID":"c94907e8-54c5-442e-9337-30955a260d11","Type":"ContainerStarted","Data":"14a0af89ee869e178dc043d4a8937be52d7bfce7eb65016d2f2410d1355c5f4a"}
Sep 11 18:53:29.431348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:29.431020    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:29.458111 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:29.458049    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9" podStartSLOduration=1.9678729499999998 podStartE2EDuration="6.458027777s" totalImagesPullingTime="3.479621286s" totalInitContainerRuntime="1.010533541s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:53:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:53:29.455906277 +0000 UTC m=+287.942830156" watchObservedRunningTime="2026-09-11 18:53:29.458027777 +0000 UTC m=+287.944951660"
Sep 11 18:53:40.439208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:40.439169    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c9988978f-ln6j9"
Sep 11 18:53:41.899108 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:41.899079    2587 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 18:53:43.466405 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466358    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"]
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466796    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="util"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466812    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="util"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466820    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="extract"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466826    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="extract"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466839    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="pull"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466845    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="pull"
Sep 11 18:53:43.468983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.466908    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b4551b7-a587-460c-a95a-ba1970666f33" containerName="extract"
Sep 11 18:53:43.469841 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.469825    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.478715 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.478692    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 18:53:43.478845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.478697    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 18:53:43.488216 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.488192    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"]
Sep 11 18:53:43.586178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.586141    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tmp\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.586392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.586188    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqcf\" (UniqueName: \"kubernetes.io/projected/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-kube-api-access-nqqcf\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.586392 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.586319    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tls-certs\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.687775 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.687736    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqcf\" (UniqueName: \"kubernetes.io/projected/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-kube-api-access-nqqcf\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.687966 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.687834    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tls-certs\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.687966 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.687873    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tmp\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.690261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.690227    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tmp\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.690428 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.690404    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-tls-certs\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.714264 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.714231    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqcf\" (UniqueName: \"kubernetes.io/projected/1fa1af5a-ec6d-49c9-951b-cd412c18f26b-kube-api-access-nqqcf\") pod \"kube-auth-proxy-5868776b49-8d8bb\" (UID: \"1fa1af5a-ec6d-49c9-951b-cd412c18f26b\") " pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:43.779951 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:43.779862    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"
Sep 11 18:53:44.080801 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:44.080774    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5868776b49-8d8bb"]
Sep 11 18:53:44.083175 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:53:44.083130    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa1af5a_ec6d_49c9_951b_cd412c18f26b.slice/crio-3d2e85fc79b9d76e33948e534393104ebcf80f4f63d9c9d8dbe1d005d0e34bdb WatchSource:0}: Error finding container 3d2e85fc79b9d76e33948e534393104ebcf80f4f63d9c9d8dbe1d005d0e34bdb: Status 404 returned error can't find the container with id 3d2e85fc79b9d76e33948e534393104ebcf80f4f63d9c9d8dbe1d005d0e34bdb
Sep 11 18:53:44.084876 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:44.084858    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:53:44.503279 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:44.503240    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb" event={"ID":"1fa1af5a-ec6d-49c9-951b-cd412c18f26b","Type":"ContainerStarted","Data":"3d2e85fc79b9d76e33948e534393104ebcf80f4f63d9c9d8dbe1d005d0e34bdb"}
Sep 11 18:53:45.866459 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.866418    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:53:45.875814 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.875779    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:45.880322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.880101    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 18:53:45.880322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.880137    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 18:53:45.880322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.880137    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 18:53:45.880590 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.880398    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 18:53:45.881802 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.881710    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fr95c\""
Sep 11 18:53:45.896729 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:45.896654    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:53:46.009250 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009204    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009429 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009257    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xsh2\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009429 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009287    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009429 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009311    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009429 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009377    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009429 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009398    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.009686 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.009443    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110337    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xsh2\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110573 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110397    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110573 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110421    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110573 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110499    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110573 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110525    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110573 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110575    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.110868 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.110642    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.111143 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.111099    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.113370 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.113342    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.113531 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.113374    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.113531 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.113452    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.113676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.113580    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.120013 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.119941    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xsh2\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.120228 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.120206    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t99z2\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:46.189466 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:46.189432    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:47.250981 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:47.250954    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:53:47.253005 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:53:47.252969    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6c16de_521c_47c6_bcad_8e87fee22ffd.slice/crio-f6f221ccb575f69f4abe907472df6463ae7b95ea52cc0e9835b38204a54ab0b0 WatchSource:0}: Error finding container f6f221ccb575f69f4abe907472df6463ae7b95ea52cc0e9835b38204a54ab0b0: Status 404 returned error can't find the container with id f6f221ccb575f69f4abe907472df6463ae7b95ea52cc0e9835b38204a54ab0b0
Sep 11 18:53:47.521572 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:47.521476    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" event={"ID":"3b6c16de-521c-47c6-bcad-8e87fee22ffd","Type":"ContainerStarted","Data":"f6f221ccb575f69f4abe907472df6463ae7b95ea52cc0e9835b38204a54ab0b0"}
Sep 11 18:53:47.522875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:47.522846    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb" event={"ID":"1fa1af5a-ec6d-49c9-951b-cd412c18f26b","Type":"ContainerStarted","Data":"42d4f37a5fd06d36df9a17b9e49deef5666112b973748efc5c5171e8f5746068"}
Sep 11 18:53:47.540903 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:47.540831    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5868776b49-8d8bb" podStartSLOduration=1.576683373 podStartE2EDuration="4.540810529s" totalImagesPullingTime="2.964127156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:53:47.539670596 +0000 UTC m=+306.026594477" watchObservedRunningTime="2026-09-11 18:53:47.540810529 +0000 UTC m=+306.027734515"
Sep 11 18:53:49.693481 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:49.693438    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:53:49.693771 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:49.693514    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:53:50.541395 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:50.541362    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" event={"ID":"3b6c16de-521c-47c6-bcad-8e87fee22ffd","Type":"ContainerStarted","Data":"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"}
Sep 11 18:53:50.541618 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:50.541552    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:53:50.543515 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:50.543479    2587 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-t99z2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 18:53:50.543651 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:50.543544    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 18:53:50.569516 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:50.569454    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" podStartSLOduration=3.131356938 podStartE2EDuration="5.56943663s" totalImagesPullingTime="2.438079692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:53:50.567431154 +0000 UTC m=+309.054355030" watchObservedRunningTime="2026-09-11 18:53:50.56943663 +0000 UTC m=+309.056360500"
Sep 11 18:53:51.547340 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:53:51.547314    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:54:05.481277 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.481239    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"]
Sep 11 18:54:05.484297 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.484278    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"]
Sep 11 18:54:05.484417 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.484394    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.487199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.487172    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.487698 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.487683    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rppxr\""
Sep 11 18:54:05.491259 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.491232    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qqtgr\""
Sep 11 18:54:05.497409 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.497387    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 18:54:05.497409 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.497398    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 18:54:05.542614 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.542561    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"]
Sep 11 18:54:05.579487 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.579446    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"]
Sep 11 18:54:05.583186 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.583150    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.583352 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.583212    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f33f7e00-42dd-4f67-888f-b245a1857788-cert\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.583352 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.583307    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xk8s\" (UniqueName: \"kubernetes.io/projected/39271a23-a8c8-48db-ad38-ca536a625322-kube-api-access-5xk8s\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.583454 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.583354    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwxmg\" (UniqueName: \"kubernetes.io/projected/f33f7e00-42dd-4f67-888f-b245a1857788-kube-api-access-xwxmg\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.684212 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.684174    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f33f7e00-42dd-4f67-888f-b245a1857788-cert\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.684412 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.684232    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xk8s\" (UniqueName: \"kubernetes.io/projected/39271a23-a8c8-48db-ad38-ca536a625322-kube-api-access-5xk8s\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.684412 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.684266    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwxmg\" (UniqueName: \"kubernetes.io/projected/f33f7e00-42dd-4f67-888f-b245a1857788-kube-api-access-xwxmg\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.684412 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.684303    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.684412 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:54:05.684402    2587 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 11 18:54:05.684588 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:54:05.684470    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert podName:39271a23-a8c8-48db-ad38-ca536a625322 nodeName:}" failed. No retries permitted until 2026-09-11 18:54:06.184453226 +0000 UTC m=+324.671377106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert") pod "llmisvc-controller-manager-777c6bd7d5-kmdvj" (UID: "39271a23-a8c8-48db-ad38-ca536a625322") : secret "llmisvc-webhook-server-cert" not found
Sep 11 18:54:05.686752 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.686730    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f33f7e00-42dd-4f67-888f-b245a1857788-cert\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.707741 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.707707    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xk8s\" (UniqueName: \"kubernetes.io/projected/39271a23-a8c8-48db-ad38-ca536a625322-kube-api-access-5xk8s\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:05.711134 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.711107    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwxmg\" (UniqueName: \"kubernetes.io/projected/f33f7e00-42dd-4f67-888f-b245a1857788-kube-api-access-xwxmg\") pod \"kserve-controller-manager-d6f4b65b8-nlrcn\" (UID: \"f33f7e00-42dd-4f67-888f-b245a1857788\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:05.800473 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:05.800372    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:06.125759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.125730    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"]
Sep 11 18:54:06.126499 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:54:06.126472    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33f7e00_42dd_4f67_888f_b245a1857788.slice/crio-3bbc7051c46d30e6af88e6718a71b2fdfe830b6296dcfc485d93ed5f58c5aba5 WatchSource:0}: Error finding container 3bbc7051c46d30e6af88e6718a71b2fdfe830b6296dcfc485d93ed5f58c5aba5: Status 404 returned error can't find the container with id 3bbc7051c46d30e6af88e6718a71b2fdfe830b6296dcfc485d93ed5f58c5aba5
Sep 11 18:54:06.190705 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.190665    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:06.193070 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.193048    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39271a23-a8c8-48db-ad38-ca536a625322-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kmdvj\" (UID: \"39271a23-a8c8-48db-ad38-ca536a625322\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:06.405510 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.405428    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:06.620223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.620187    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn" event={"ID":"f33f7e00-42dd-4f67-888f-b245a1857788","Type":"ContainerStarted","Data":"3bbc7051c46d30e6af88e6718a71b2fdfe830b6296dcfc485d93ed5f58c5aba5"}
Sep 11 18:54:06.687243 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.687207    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"]
Sep 11 18:54:06.689061 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:54:06.689034    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39271a23_a8c8_48db_ad38_ca536a625322.slice/crio-4affa4b0e2d89022801a7897d3d2feeb4bd866db78280148bff82b1cab2de05f WatchSource:0}: Error finding container 4affa4b0e2d89022801a7897d3d2feeb4bd866db78280148bff82b1cab2de05f: Status 404 returned error can't find the container with id 4affa4b0e2d89022801a7897d3d2feeb4bd866db78280148bff82b1cab2de05f
Sep 11 18:54:06.980236 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.980150    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:54:06.980437 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:06.980385    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerName="discovery" containerID="cri-o://24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3" gracePeriod=30
Sep 11 18:54:07.267411 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.267386    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:54:07.399856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.399821    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xsh2\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400028 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.399881    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400028 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.399963    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400028 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.399995    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.400044    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.400071    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.400203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.400125    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token\") pod \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\" (UID: \"3b6c16de-521c-47c6-bcad-8e87fee22ffd\") "
Sep 11 18:54:07.401051 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.401018    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:54:07.403100 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.403071    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:54:07.403433 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.403392    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:54:07.404976 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.404948    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs" (OuterVolumeSpecName: "local-certs") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:54:07.405087 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.405032    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:54:07.405087 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.405054    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts" (OuterVolumeSpecName: "cacerts") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:54:07.405087 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.405078    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2" (OuterVolumeSpecName: "kube-api-access-5xsh2") pod "3b6c16de-521c-47c6-bcad-8e87fee22ffd" (UID: "3b6c16de-521c-47c6-bcad-8e87fee22ffd"). InnerVolumeSpecName "kube-api-access-5xsh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501775    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501812    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xsh2\" (UniqueName: \"kubernetes.io/projected/3b6c16de-521c-47c6-bcad-8e87fee22ffd-kube-api-access-5xsh2\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501824    2587 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-cacerts\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501835    2587 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6c16de-521c-47c6-bcad-8e87fee22ffd-local-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501844    2587 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-dns-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.501851 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501852    2587 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-csr-ca-configmap\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.502194 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.501861    2587 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b6c16de-521c-47c6-bcad-8e87fee22ffd-istio-kubeconfig\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:54:07.629252 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.629209    2587 generic.go:356] "Generic (PLEG): container finished" podID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerID="24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3" exitCode=0
Sep 11 18:54:07.629759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.629262    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"
Sep 11 18:54:07.629759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.629295    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" event={"ID":"3b6c16de-521c-47c6-bcad-8e87fee22ffd","Type":"ContainerDied","Data":"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"}
Sep 11 18:54:07.629759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.629362    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2" event={"ID":"3b6c16de-521c-47c6-bcad-8e87fee22ffd","Type":"ContainerDied","Data":"f6f221ccb575f69f4abe907472df6463ae7b95ea52cc0e9835b38204a54ab0b0"}
Sep 11 18:54:07.629759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.629395    2587 scope.go:117] "RemoveContainer" containerID="24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"
Sep 11 18:54:07.631086 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.631055    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj" event={"ID":"39271a23-a8c8-48db-ad38-ca536a625322","Type":"ContainerStarted","Data":"4affa4b0e2d89022801a7897d3d2feeb4bd866db78280148bff82b1cab2de05f"}
Sep 11 18:54:07.665439 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.665405    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:54:07.681229 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.681188    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t99z2"]
Sep 11 18:54:07.998195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:07.998158    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" path="/var/lib/kubelet/pods/3b6c16de-521c-47c6-bcad-8e87fee22ffd/volumes"
Sep 11 18:54:08.166452 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:08.166291    2587 scope.go:117] "RemoveContainer" containerID="24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"
Sep 11 18:54:08.166753 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:54:08.166729    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3\": container with ID starting with 24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3 not found: ID does not exist" containerID="24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"
Sep 11 18:54:08.166836 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:08.166765    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3"} err="failed to get container status \"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3\": rpc error: code = NotFound desc = could not find container \"24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3\": container with ID starting with 24dbff376963d8d76f5a30221739ea4ae14b6837336c9dfe0395f5e4682365f3 not found: ID does not exist"
Sep 11 18:54:08.638123 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:08.638079    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn" event={"ID":"f33f7e00-42dd-4f67-888f-b245a1857788","Type":"ContainerStarted","Data":"3dfad30326f40ce1fb5d789767c94c6f1c6eb4326fbff896e07049c4ef861120"}
Sep 11 18:54:08.638579 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:08.638266    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:10.650019 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:10.649977    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj" event={"ID":"39271a23-a8c8-48db-ad38-ca536a625322","Type":"ContainerStarted","Data":"aa4bd224cfd2f41d60d4da33d5c49ba010cf4a12404648e33574bbd6dbc6dab2"}
Sep 11 18:54:10.650525 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:10.650122    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:10.672169 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:10.672118    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj" podStartSLOduration=2.7727107699999998 podStartE2EDuration="5.672102514s" totalImagesPullingTime="2.899391744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:10.669968346 +0000 UTC m=+329.156892225" watchObservedRunningTime="2026-09-11 18:54:10.672102514 +0000 UTC m=+329.159026414"
Sep 11 18:54:10.672365 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:10.672346    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn" podStartSLOduration=3.348119201 podStartE2EDuration="5.67233832s" totalImagesPullingTime="2.324219119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:54:08.658445036 +0000 UTC m=+327.145368916" watchObservedRunningTime="2026-09-11 18:54:10.67233832 +0000 UTC m=+329.159262198"
Sep 11 18:54:39.649199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:39.649118    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nlrcn"
Sep 11 18:54:41.657298 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:41.657268    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kmdvj"
Sep 11 18:54:59.142563 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.142527    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"]
Sep 11 18:54:59.143021 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.142866    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerName="discovery"
Sep 11 18:54:59.143021 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.142878    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerName="discovery"
Sep 11 18:54:59.143021 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.142948    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6c16de-521c-47c6-bcad-8e87fee22ffd" containerName="discovery"
Sep 11 18:54:59.149886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.149866    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.152092 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.152072    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sk69z\""
Sep 11 18:54:59.152242 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.152216    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 18:54:59.152557 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.152542    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 18:54:59.156660 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.156635    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"]
Sep 11 18:54:59.228496 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.228455    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.228697 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.228525    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcjd\" (UniqueName: \"kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.228697 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.228661    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.242856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.242822    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"]
Sep 11 18:54:59.246652 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.246635    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.257338 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.257310    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"]
Sep 11 18:54:59.329090 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329053    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xddp\" (UniqueName: \"kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.329300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329101    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.329300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329172    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.329300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329207    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcjd\" (UniqueName: \"kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.329300 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329282    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.329511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329337    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.329511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329478    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.329668 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.329651    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.337282 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.337260    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcjd\" (UniqueName: \"kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.346726 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.346698    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"]
Sep 11 18:54:59.350461 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.350440    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.360117 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.360090    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"]
Sep 11 18:54:59.430396 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430364    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.430396 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430409    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z5tb\" (UniqueName: \"kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.430670 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430446    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xddp\" (UniqueName: \"kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.430670 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430474    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.430670 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430548    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.430670 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430635    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.430882 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430832    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.430962 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.430940    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.441443 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.441418    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"]
Sep 11 18:54:59.442760 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.442734    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xddp\" (UniqueName: \"kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.445379 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.445359    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.455699 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.455675    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"]
Sep 11 18:54:59.460753 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.460731    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:54:59.531223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531180    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.531388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531299    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z5tb\" (UniqueName: \"kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.531388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531345    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.531388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531378    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.531494 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531395    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.531494 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531412    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpgvx\" (UniqueName: \"kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.531821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531801    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.531879 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.531860    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.540140 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.540110    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z5tb\" (UniqueName: \"kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.555860 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.555821    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:54:59.632200 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.632162    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.632382 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.632230    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpgvx\" (UniqueName: \"kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.632382 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.632293    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.632695 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.632668    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.632695 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.632684    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.640697 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.640673    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpgvx\" (UniqueName: \"kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.660635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.660583    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:54:59.735104 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.735017    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"]
Sep 11 18:54:59.737950 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:54:59.737910    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d01593_f15a_4832_9cef_4a146c17114c.slice/crio-dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc WatchSource:0}: Error finding container dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc: Status 404 returned error can't find the container with id dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc
Sep 11 18:54:59.759342 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.759321    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:54:59.833500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.833469    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"]
Sep 11 18:54:59.835304 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:54:59.835274    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc89c4950_4904_48c2_a91b_39430fc41a77.slice/crio-1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45 WatchSource:0}: Error finding container 1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45: Status 404 returned error can't find the container with id 1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45
Sep 11 18:54:59.886136 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.886106    2587 generic.go:356] "Generic (PLEG): container finished" podID="f5d01593-f15a-4832-9cef-4a146c17114c" containerID="3375284685f1062b2c5de9ff7c2dad8c4d5e324b24984a379df01ac8af6b410d" exitCode=0
Sep 11 18:54:59.886245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.886189    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8" event={"ID":"f5d01593-f15a-4832-9cef-4a146c17114c","Type":"ContainerDied","Data":"3375284685f1062b2c5de9ff7c2dad8c4d5e324b24984a379df01ac8af6b410d"}
Sep 11 18:54:59.886245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.886239    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8" event={"ID":"f5d01593-f15a-4832-9cef-4a146c17114c","Type":"ContainerStarted","Data":"dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc"}
Sep 11 18:54:59.887469 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.887440    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z" event={"ID":"c89c4950-4904-48c2-a91b-39430fc41a77","Type":"ContainerStarted","Data":"1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45"}
Sep 11 18:54:59.936076 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:54:59.936050    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"]
Sep 11 18:54:59.937854 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:54:59.937829    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceae9032_1c49_4d57_8b04_ffd60cb5dc4c.slice/crio-e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7 WatchSource:0}: Error finding container e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7: Status 404 returned error can't find the container with id e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7
Sep 11 18:55:00.035464 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.035429    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"]
Sep 11 18:55:00.044575 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:00.044540    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4b56a3_014b_4d6d_9609_086f12b92f6c.slice/crio-5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae WatchSource:0}: Error finding container 5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae: Status 404 returned error can't find the container with id 5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae
Sep 11 18:55:00.893767 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.893723    2587 generic.go:356] "Generic (PLEG): container finished" podID="c89c4950-4904-48c2-a91b-39430fc41a77" containerID="8c88e3cf87c8803b7f8b19248d11824df00aa320985c20a2d1f8a2f9236c13a1" exitCode=0
Sep 11 18:55:00.894189 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.893804    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z" event={"ID":"c89c4950-4904-48c2-a91b-39430fc41a77","Type":"ContainerDied","Data":"8c88e3cf87c8803b7f8b19248d11824df00aa320985c20a2d1f8a2f9236c13a1"}
Sep 11 18:55:00.895432 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.895413    2587 generic.go:356] "Generic (PLEG): container finished" podID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerID="c8cb3c854522138b17ec3440bc34a840f0e89cec90ab5f7ec993683fb8ad51ef" exitCode=0
Sep 11 18:55:00.895506 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.895474    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx" event={"ID":"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c","Type":"ContainerDied","Data":"c8cb3c854522138b17ec3440bc34a840f0e89cec90ab5f7ec993683fb8ad51ef"}
Sep 11 18:55:00.895565 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.895523    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx" event={"ID":"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c","Type":"ContainerStarted","Data":"e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7"}
Sep 11 18:55:00.898464 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.898445    2587 generic.go:356] "Generic (PLEG): container finished" podID="f5d01593-f15a-4832-9cef-4a146c17114c" containerID="e982c7f9de3d486dda89b6643511efc7b350c2855c006f811b0cc0b73d14ef2b" exitCode=0
Sep 11 18:55:00.898544 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.898469    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8" event={"ID":"f5d01593-f15a-4832-9cef-4a146c17114c","Type":"ContainerDied","Data":"e982c7f9de3d486dda89b6643511efc7b350c2855c006f811b0cc0b73d14ef2b"}
Sep 11 18:55:00.900683 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.900639    2587 generic.go:356] "Generic (PLEG): container finished" podID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerID="97903cb68f4c65ab6754c2f404f33ef22abbfc24622d1728d57f3e3bdfa02fee" exitCode=0
Sep 11 18:55:00.900759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.900689    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5" event={"ID":"7b4b56a3-014b-4d6d-9609-086f12b92f6c","Type":"ContainerDied","Data":"97903cb68f4c65ab6754c2f404f33ef22abbfc24622d1728d57f3e3bdfa02fee"}
Sep 11 18:55:00.900759 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:00.900719    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5" event={"ID":"7b4b56a3-014b-4d6d-9609-086f12b92f6c","Type":"ContainerStarted","Data":"5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae"}
Sep 11 18:55:01.908640 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:01.908566    2587 generic.go:356] "Generic (PLEG): container finished" podID="f5d01593-f15a-4832-9cef-4a146c17114c" containerID="2666c12ef8443b6925b78909760a2c5110cd93c3e7f1d34f51b6b52904635e5d" exitCode=0
Sep 11 18:55:01.909073 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:01.908705    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8" event={"ID":"f5d01593-f15a-4832-9cef-4a146c17114c","Type":"ContainerDied","Data":"2666c12ef8443b6925b78909760a2c5110cd93c3e7f1d34f51b6b52904635e5d"}
Sep 11 18:55:02.915792 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:02.915752    2587 generic.go:356] "Generic (PLEG): container finished" podID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerID="f7c31e12aab4bd3ae6a303814eb24372a155a4a5784c70146d4ac677fb76bf7b" exitCode=0
Sep 11 18:55:02.916221 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:02.915852    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5" event={"ID":"7b4b56a3-014b-4d6d-9609-086f12b92f6c","Type":"ContainerDied","Data":"f7c31e12aab4bd3ae6a303814eb24372a155a4a5784c70146d4ac677fb76bf7b"}
Sep 11 18:55:02.917879 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:02.917856    2587 generic.go:356] "Generic (PLEG): container finished" podID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerID="b956fa9a5724aa700c23b1dbc8be968e317ad5620eb49b74e92db58772c6e79e" exitCode=0
Sep 11 18:55:02.917983 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:02.917932    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx" event={"ID":"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c","Type":"ContainerDied","Data":"b956fa9a5724aa700c23b1dbc8be968e317ad5620eb49b74e92db58772c6e79e"}
Sep 11 18:55:03.050103 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.050073    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:55:03.103066 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:03.103033    2587 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4b56a3_014b_4d6d_9609_086f12b92f6c.slice/crio-49cdea5c7de6078351597544a68156136d59122b8b3f94bde10d91cf05276e93.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceae9032_1c49_4d57_8b04_ffd60cb5dc4c.slice/crio-b58825d06cc75fe2b8753dc542c0aed6c1b6fb15f21920e3ed3b748e82e6ef99.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceae9032_1c49_4d57_8b04_ffd60cb5dc4c.slice/crio-conmon-b58825d06cc75fe2b8753dc542c0aed6c1b6fb15f21920e3ed3b748e82e6ef99.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 18:55:03.161469 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.161442    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util\") pod \"f5d01593-f15a-4832-9cef-4a146c17114c\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") "
Sep 11 18:55:03.161612 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.161478    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle\") pod \"f5d01593-f15a-4832-9cef-4a146c17114c\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") "
Sep 11 18:55:03.161612 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.161503    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlcjd\" (UniqueName: \"kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd\") pod \"f5d01593-f15a-4832-9cef-4a146c17114c\" (UID: \"f5d01593-f15a-4832-9cef-4a146c17114c\") "
Sep 11 18:55:03.162155 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.162126    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle" (OuterVolumeSpecName: "bundle") pod "f5d01593-f15a-4832-9cef-4a146c17114c" (UID: "f5d01593-f15a-4832-9cef-4a146c17114c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:03.163567 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.163549    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd" (OuterVolumeSpecName: "kube-api-access-nlcjd") pod "f5d01593-f15a-4832-9cef-4a146c17114c" (UID: "f5d01593-f15a-4832-9cef-4a146c17114c"). InnerVolumeSpecName "kube-api-access-nlcjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:03.167052 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.167009    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util" (OuterVolumeSpecName: "util") pod "f5d01593-f15a-4832-9cef-4a146c17114c" (UID: "f5d01593-f15a-4832-9cef-4a146c17114c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:03.263129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.263095    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:03.263129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.263122    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5d01593-f15a-4832-9cef-4a146c17114c-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:03.263129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.263132    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlcjd\" (UniqueName: \"kubernetes.io/projected/f5d01593-f15a-4832-9cef-4a146c17114c-kube-api-access-nlcjd\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:03.931462 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.931431    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8"
Sep 11 18:55:03.931912 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.931425    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2xnp8" event={"ID":"f5d01593-f15a-4832-9cef-4a146c17114c","Type":"ContainerDied","Data":"dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc"}
Sep 11 18:55:03.931912 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.931604    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dba5898b8cc2ba022d67acc5005130efbf0c99458ff591dff620528f1b19c1bc"
Sep 11 18:55:03.933710 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.933685    2587 generic.go:356] "Generic (PLEG): container finished" podID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerID="49cdea5c7de6078351597544a68156136d59122b8b3f94bde10d91cf05276e93" exitCode=0
Sep 11 18:55:03.933834 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.933744    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5" event={"ID":"7b4b56a3-014b-4d6d-9609-086f12b92f6c","Type":"ContainerDied","Data":"49cdea5c7de6078351597544a68156136d59122b8b3f94bde10d91cf05276e93"}
Sep 11 18:55:03.936025 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.936002    2587 generic.go:356] "Generic (PLEG): container finished" podID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerID="b58825d06cc75fe2b8753dc542c0aed6c1b6fb15f21920e3ed3b748e82e6ef99" exitCode=0
Sep 11 18:55:03.936131 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:03.936083    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx" event={"ID":"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c","Type":"ContainerDied","Data":"b58825d06cc75fe2b8753dc542c0aed6c1b6fb15f21920e3ed3b748e82e6ef99"}
Sep 11 18:55:05.069275 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.069245    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:55:05.100838 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.100812    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:55:05.179532 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179498    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpgvx\" (UniqueName: \"kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx\") pod \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") "
Sep 11 18:55:05.179746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179563    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util\") pod \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") "
Sep 11 18:55:05.179746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179619    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z5tb\" (UniqueName: \"kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb\") pod \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") "
Sep 11 18:55:05.179746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179642    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle\") pod \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") "
Sep 11 18:55:05.179746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179667    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle\") pod \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\" (UID: \"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c\") "
Sep 11 18:55:05.179746 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.179700    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util\") pod \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\" (UID: \"7b4b56a3-014b-4d6d-9609-086f12b92f6c\") "
Sep 11 18:55:05.180280 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.180231    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle" (OuterVolumeSpecName: "bundle") pod "7b4b56a3-014b-4d6d-9609-086f12b92f6c" (UID: "7b4b56a3-014b-4d6d-9609-086f12b92f6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:05.180280 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.180260    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle" (OuterVolumeSpecName: "bundle") pod "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" (UID: "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:05.181927 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.181899    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx" (OuterVolumeSpecName: "kube-api-access-hpgvx") pod "7b4b56a3-014b-4d6d-9609-086f12b92f6c" (UID: "7b4b56a3-014b-4d6d-9609-086f12b92f6c"). InnerVolumeSpecName "kube-api-access-hpgvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:05.182120 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.182089    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb" (OuterVolumeSpecName: "kube-api-access-5z5tb") pod "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" (UID: "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c"). InnerVolumeSpecName "kube-api-access-5z5tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:05.185225 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.185186    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util" (OuterVolumeSpecName: "util") pod "7b4b56a3-014b-4d6d-9609-086f12b92f6c" (UID: "7b4b56a3-014b-4d6d-9609-086f12b92f6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:05.185963 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.185942    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util" (OuterVolumeSpecName: "util") pod "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" (UID: "ceae9032-1c49-4d57-8b04-ffd60cb5dc4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281108    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpgvx\" (UniqueName: \"kubernetes.io/projected/7b4b56a3-014b-4d6d-9609-086f12b92f6c-kube-api-access-hpgvx\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281150    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281161    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z5tb\" (UniqueName: \"kubernetes.io/projected/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-kube-api-access-5z5tb\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281170    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281178    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceae9032-1c49-4d57-8b04-ffd60cb5dc4c-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.281203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.281186    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b4b56a3-014b-4d6d-9609-086f12b92f6c-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:05.948690 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.948647    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5" event={"ID":"7b4b56a3-014b-4d6d-9609-086f12b92f6c","Type":"ContainerDied","Data":"5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae"}
Sep 11 18:55:05.948886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.948714    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fcfb3b835d2a1c9b701a31973a53a9dc1d68c33995539037c06832dd2e046ae"
Sep 11 18:55:05.948886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.948664    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fzvb5"
Sep 11 18:55:05.950440 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.950422    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx"
Sep 11 18:55:05.950440 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.950427    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cch6gx" event={"ID":"ceae9032-1c49-4d57-8b04-ffd60cb5dc4c","Type":"ContainerDied","Data":"e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7"}
Sep 11 18:55:05.950566 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:05.950464    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e456d6764090beebc9071b24dae21c6e963f1867b0923e7de77b243c18443ff7"
Sep 11 18:55:11.984610 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:11.984558    2587 generic.go:356] "Generic (PLEG): container finished" podID="c89c4950-4904-48c2-a91b-39430fc41a77" containerID="c7ea006f2d287fb65047b8e2a6320f277f7b37810c8a9eaa69d3adccb3e99285" exitCode=0
Sep 11 18:55:11.985027 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:11.984658    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z" event={"ID":"c89c4950-4904-48c2-a91b-39430fc41a77","Type":"ContainerDied","Data":"c7ea006f2d287fb65047b8e2a6320f277f7b37810c8a9eaa69d3adccb3e99285"}
Sep 11 18:55:12.992885 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:12.992854    2587 generic.go:356] "Generic (PLEG): container finished" podID="c89c4950-4904-48c2-a91b-39430fc41a77" containerID="f442997943d1bcc365105d2573243d53b778211bcb86264b8992c2e1b54cb132" exitCode=0
Sep 11 18:55:12.993280 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:12.992946    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z" event={"ID":"c89c4950-4904-48c2-a91b-39430fc41a77","Type":"ContainerDied","Data":"f442997943d1bcc365105d2573243d53b778211bcb86264b8992c2e1b54cb132"}
Sep 11 18:55:14.123987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.123962    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:55:14.261789 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.261701    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util\") pod \"c89c4950-4904-48c2-a91b-39430fc41a77\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") "
Sep 11 18:55:14.261789 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.261774    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle\") pod \"c89c4950-4904-48c2-a91b-39430fc41a77\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") "
Sep 11 18:55:14.261973 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.261811    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xddp\" (UniqueName: \"kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp\") pod \"c89c4950-4904-48c2-a91b-39430fc41a77\" (UID: \"c89c4950-4904-48c2-a91b-39430fc41a77\") "
Sep 11 18:55:14.262208 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.262172    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle" (OuterVolumeSpecName: "bundle") pod "c89c4950-4904-48c2-a91b-39430fc41a77" (UID: "c89c4950-4904-48c2-a91b-39430fc41a77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:14.263935 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.263901    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp" (OuterVolumeSpecName: "kube-api-access-9xddp") pod "c89c4950-4904-48c2-a91b-39430fc41a77" (UID: "c89c4950-4904-48c2-a91b-39430fc41a77"). InnerVolumeSpecName "kube-api-access-9xddp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:14.266278 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.266258    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util" (OuterVolumeSpecName: "util") pod "c89c4950-4904-48c2-a91b-39430fc41a77" (UID: "c89c4950-4904-48c2-a91b-39430fc41a77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:14.363139 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.363107    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xddp\" (UniqueName: \"kubernetes.io/projected/c89c4950-4904-48c2-a91b-39430fc41a77-kube-api-access-9xddp\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:14.363139 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.363136    2587 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-util\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:14.363334 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:14.363173    2587 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c89c4950-4904-48c2-a91b-39430fc41a77-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:15.004049 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:15.004018    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z" event={"ID":"c89c4950-4904-48c2-a91b-39430fc41a77","Type":"ContainerDied","Data":"1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45"}
Sep 11 18:55:15.004049 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:15.004041    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xc86z"
Sep 11 18:55:15.004224 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:15.004060    2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f1718632d39863f7c100d78d66cb052b2ada2df80ceca426b692f0682490a45"
Sep 11 18:55:21.521906 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.521864    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d9d8dffc-rc5fh"]
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522270    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522290    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522308    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522317    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522332    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="util"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522341    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="util"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522350    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522357    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522369    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="util"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522377    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="util"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522393    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522401    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="pull"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522411    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="extract"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522419    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="extract"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522431    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="extract"
Sep 11 18:55:21.522475 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522438    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522486    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="util"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522498    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="util"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522510    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522520    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522531    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522540    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522556    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="util"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522563    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="util"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522676    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b4b56a3-014b-4d6d-9609-086f12b92f6c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522690    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceae9032-1c49-4d57-8b04-ffd60cb5dc4c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522702    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d01593-f15a-4832-9cef-4a146c17114c" containerName="extract"
Sep 11 18:55:21.522980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.522710    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="c89c4950-4904-48c2-a91b-39430fc41a77" containerName="extract"
Sep 11 18:55:21.526362 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.526344    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.541245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.541219    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d9d8dffc-rc5fh"]
Sep 11 18:55:21.620179 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620147    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620202    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620221    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-oauth-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620244    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jzd\" (UniqueName: \"kubernetes.io/projected/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-kube-api-access-h7jzd\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620285    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-oauth-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620303    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-trusted-ca-bundle\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.620372 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.620348    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-service-ca\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721119 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721078    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721119 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721120    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-oauth-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721334 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721137    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jzd\" (UniqueName: \"kubernetes.io/projected/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-kube-api-access-h7jzd\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721334 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721165    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-oauth-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721334 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721184    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-trusted-ca-bundle\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721458 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721327    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-service-ca\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721458 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721421    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.721984 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721959    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.722096 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721994    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-oauth-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.722096 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.721995    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-service-ca\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.722165 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.722151    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-trusted-ca-bundle\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.723741 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.723719    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-oauth-config\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.723951 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.723929    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-console-serving-cert\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.730974 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.730952    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jzd\" (UniqueName: \"kubernetes.io/projected/5653c9ff-bcfe-4c84-b807-fb5b2a7224ee-kube-api-access-h7jzd\") pod \"console-69d9d8dffc-rc5fh\" (UID: \"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee\") " pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.835664 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.835548    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:21.971237 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.971202    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"]
Sep 11 18:55:21.974944 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.974921    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:21.977521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.977499    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6kzjd\""
Sep 11 18:55:21.977521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.977512    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 18:55:21.978699 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.978679    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 18:55:21.987251 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:21.987221    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"]
Sep 11 18:55:22.023934 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.023902    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgms\" (UniqueName: \"kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms\") pod \"limitador-operator-controller-manager-74495c69f8-h89sm\" (UID: \"55883c84-489c-4407-b408-c810c178cb00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:22.111689 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.111661    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d9d8dffc-rc5fh"]
Sep 11 18:55:22.114017 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:22.113988    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5653c9ff_bcfe_4c84_b807_fb5b2a7224ee.slice/crio-1796152228f458e63743012fde3c901753235b8b0f49816506cd44e937203bce WatchSource:0}: Error finding container 1796152228f458e63743012fde3c901753235b8b0f49816506cd44e937203bce: Status 404 returned error can't find the container with id 1796152228f458e63743012fde3c901753235b8b0f49816506cd44e937203bce
Sep 11 18:55:22.124610 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.124574    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgms\" (UniqueName: \"kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms\") pod \"limitador-operator-controller-manager-74495c69f8-h89sm\" (UID: \"55883c84-489c-4407-b408-c810c178cb00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:22.137823 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.137801    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgms\" (UniqueName: \"kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms\") pod \"limitador-operator-controller-manager-74495c69f8-h89sm\" (UID: \"55883c84-489c-4407-b408-c810c178cb00\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:22.286167 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.286135    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:22.563263 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:22.563238    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"]
Sep 11 18:55:22.564205 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:22.564174    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55883c84_489c_4407_b408_c810c178cb00.slice/crio-076fbf3bcfeb2cde9b71cf8f96e7b4ac3e15ec1a7d3f02d7ee59ac31211f6df1 WatchSource:0}: Error finding container 076fbf3bcfeb2cde9b71cf8f96e7b4ac3e15ec1a7d3f02d7ee59ac31211f6df1: Status 404 returned error can't find the container with id 076fbf3bcfeb2cde9b71cf8f96e7b4ac3e15ec1a7d3f02d7ee59ac31211f6df1
Sep 11 18:55:23.043978 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:23.043946    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9d8dffc-rc5fh" event={"ID":"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee","Type":"ContainerStarted","Data":"33a3b03714a678922537315cd5a1f06fcf522857b8cf4eb68d2719c6a6ed3aa0"}
Sep 11 18:55:23.044155 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:23.044002    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d9d8dffc-rc5fh" event={"ID":"5653c9ff-bcfe-4c84-b807-fb5b2a7224ee","Type":"ContainerStarted","Data":"1796152228f458e63743012fde3c901753235b8b0f49816506cd44e937203bce"}
Sep 11 18:55:23.045313 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:23.045291    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm" event={"ID":"55883c84-489c-4407-b408-c810c178cb00","Type":"ContainerStarted","Data":"076fbf3bcfeb2cde9b71cf8f96e7b4ac3e15ec1a7d3f02d7ee59ac31211f6df1"}
Sep 11 18:55:23.067519 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:23.067469    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d9d8dffc-rc5fh" podStartSLOduration=2.067454639 podStartE2EDuration="2.067454639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:23.065009648 +0000 UTC m=+401.551933553" watchObservedRunningTime="2026-09-11 18:55:23.067454639 +0000 UTC m=+401.554378518"
Sep 11 18:55:24.495753 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.495714    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4242g"]
Sep 11 18:55:24.500899 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.500870    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:24.503691 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.503655    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zbsnz\""
Sep 11 18:55:24.513322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.513292    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4242g"]
Sep 11 18:55:24.547992 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.547954    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxmq9\" (UniqueName: \"kubernetes.io/projected/3e6df157-8c1f-4cdb-b620-fa68cbac2fb0-kube-api-access-wxmq9\") pod \"authorino-operator-76b478bd78-4242g\" (UID: \"3e6df157-8c1f-4cdb-b620-fa68cbac2fb0\") " pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:24.648647 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.648575    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxmq9\" (UniqueName: \"kubernetes.io/projected/3e6df157-8c1f-4cdb-b620-fa68cbac2fb0-kube-api-access-wxmq9\") pod \"authorino-operator-76b478bd78-4242g\" (UID: \"3e6df157-8c1f-4cdb-b620-fa68cbac2fb0\") " pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:24.661150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.661117    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxmq9\" (UniqueName: \"kubernetes.io/projected/3e6df157-8c1f-4cdb-b620-fa68cbac2fb0-kube-api-access-wxmq9\") pod \"authorino-operator-76b478bd78-4242g\" (UID: \"3e6df157-8c1f-4cdb-b620-fa68cbac2fb0\") " pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:24.813667 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:24.813556    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:25.357479 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:25.357450    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-4242g"]
Sep 11 18:55:25.358856 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:25.358830    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6df157_8c1f_4cdb_b620_fa68cbac2fb0.slice/crio-19f1ab2bbabdcf86ffb2ec7b0e9c479bc84e1e27f9dc3b6d059facf03db09c17 WatchSource:0}: Error finding container 19f1ab2bbabdcf86ffb2ec7b0e9c479bc84e1e27f9dc3b6d059facf03db09c17: Status 404 returned error can't find the container with id 19f1ab2bbabdcf86ffb2ec7b0e9c479bc84e1e27f9dc3b6d059facf03db09c17
Sep 11 18:55:26.063989 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.063954    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4242g" event={"ID":"3e6df157-8c1f-4cdb-b620-fa68cbac2fb0","Type":"ContainerStarted","Data":"19f1ab2bbabdcf86ffb2ec7b0e9c479bc84e1e27f9dc3b6d059facf03db09c17"}
Sep 11 18:55:26.065635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.065609    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm" event={"ID":"55883c84-489c-4407-b408-c810c178cb00","Type":"ContainerStarted","Data":"42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4"}
Sep 11 18:55:26.065877 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.065859    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:26.089770 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.089726    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm" podStartSLOduration=2.552119807 podStartE2EDuration="5.089709592s" totalImagesPullingTime="2.537589785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:26.087654705 +0000 UTC m=+404.574578586" watchObservedRunningTime="2026-09-11 18:55:26.089709592 +0000 UTC m=+404.576633470"
Sep 11 18:55:26.745436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.745382    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"]
Sep 11 18:55:26.749290 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.749264    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:26.756729 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.756700    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 18:55:26.756878 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.756707    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ldlss\""
Sep 11 18:55:26.766473 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.766448    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsmm\" (UniqueName: \"kubernetes.io/projected/6cb3d983-9a45-4bff-aa78-6ae7d7d283e9-kube-api-access-pjsmm\") pod \"dns-operator-controller-manager-7b84cd7c9c-dnbqd\" (UID: \"6cb3d983-9a45-4bff-aa78-6ae7d7d283e9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:26.773388 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.773356    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"]
Sep 11 18:55:26.867341 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.867297    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsmm\" (UniqueName: \"kubernetes.io/projected/6cb3d983-9a45-4bff-aa78-6ae7d7d283e9-kube-api-access-pjsmm\") pod \"dns-operator-controller-manager-7b84cd7c9c-dnbqd\" (UID: \"6cb3d983-9a45-4bff-aa78-6ae7d7d283e9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:26.886182 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:26.886148    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsmm\" (UniqueName: \"kubernetes.io/projected/6cb3d983-9a45-4bff-aa78-6ae7d7d283e9-kube-api-access-pjsmm\") pod \"dns-operator-controller-manager-7b84cd7c9c-dnbqd\" (UID: \"6cb3d983-9a45-4bff-aa78-6ae7d7d283e9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:27.061358 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:27.061319    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:27.072663 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:27.072623    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-4242g" event={"ID":"3e6df157-8c1f-4cdb-b620-fa68cbac2fb0","Type":"ContainerStarted","Data":"990c2301a2608f8d7afef160c76dbf917409e68af0a3f8d012034e3ccea0a183"}
Sep 11 18:55:27.073050 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:27.072739    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:27.095488 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:27.095432    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-4242g" podStartSLOduration=1.4904836129999999 podStartE2EDuration="3.095413608s" totalImagesPullingTime="1.604929995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:27.093677908 +0000 UTC m=+405.580601787" watchObservedRunningTime="2026-09-11 18:55:27.095413608 +0000 UTC m=+405.582337486"
Sep 11 18:55:27.380860 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:27.380832    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"]
Sep 11 18:55:27.383116 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:27.383086    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb3d983_9a45_4bff_aa78_6ae7d7d283e9.slice/crio-305e11cc419b16c0266cd882d990ee27e0dc42ab196f0adf61b04770f15d4527 WatchSource:0}: Error finding container 305e11cc419b16c0266cd882d990ee27e0dc42ab196f0adf61b04770f15d4527: Status 404 returned error can't find the container with id 305e11cc419b16c0266cd882d990ee27e0dc42ab196f0adf61b04770f15d4527
Sep 11 18:55:28.079258 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:28.079214    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd" event={"ID":"6cb3d983-9a45-4bff-aa78-6ae7d7d283e9","Type":"ContainerStarted","Data":"305e11cc419b16c0266cd882d990ee27e0dc42ab196f0adf61b04770f15d4527"}
Sep 11 18:55:30.092501 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:30.092460    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd" event={"ID":"6cb3d983-9a45-4bff-aa78-6ae7d7d283e9","Type":"ContainerStarted","Data":"51ba47fdaba6fdb9290b2c3a6007904c0b119f267d1b0733ed4f505dcb040f59"}
Sep 11 18:55:30.093038 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:30.092538    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:30.114159 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:30.114100    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd" podStartSLOduration=2.010588457 podStartE2EDuration="4.114081455s" totalImagesPullingTime="2.103492998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:30.112769999 +0000 UTC m=+408.599693878" watchObservedRunningTime="2026-09-11 18:55:30.114081455 +0000 UTC m=+408.601005348"
Sep 11 18:55:31.476635 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.476603    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"]
Sep 11 18:55:31.480500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.480482    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.483644 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.483619    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r9t7x\""
Sep 11 18:55:31.508371 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.508340    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"]
Sep 11 18:55:31.510107 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.510080    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.510202 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.510167    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86jll\" (UniqueName: \"kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.611133 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.611088    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86jll\" (UniqueName: \"kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.611314 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.611243    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.611580 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.611564    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.629227 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.629198    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86jll\" (UniqueName: \"kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll\") pod \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.790966 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.790862    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:31.836105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.836071    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:31.836274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.836125    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:31.843114 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:31.843088    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:32.068313 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:32.068278    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"]
Sep 11 18:55:32.071402 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:32.071368    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9364e9_18a8_4bb7_bb15_353d705af891.slice/crio-6d27a33e499e0bf9c46ba72576cbf9206b71d832a4e57d7724566eca16bd0a8a WatchSource:0}: Error finding container 6d27a33e499e0bf9c46ba72576cbf9206b71d832a4e57d7724566eca16bd0a8a: Status 404 returned error can't find the container with id 6d27a33e499e0bf9c46ba72576cbf9206b71d832a4e57d7724566eca16bd0a8a
Sep 11 18:55:32.105054 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:32.105019    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7" event={"ID":"6f9364e9-18a8-4bb7-bb15-353d705af891","Type":"ContainerStarted","Data":"6d27a33e499e0bf9c46ba72576cbf9206b71d832a4e57d7724566eca16bd0a8a"}
Sep 11 18:55:32.108916 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:32.108894    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d9d8dffc-rc5fh"
Sep 11 18:55:32.179262 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:32.179227    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:55:36.131190 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:36.131143    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7" event={"ID":"6f9364e9-18a8-4bb7-bb15-353d705af891","Type":"ContainerStarted","Data":"b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f"}
Sep 11 18:55:36.131618 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:36.131408    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:36.182423 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:36.182360    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7" podStartSLOduration=1.238205647 podStartE2EDuration="5.182338997s" totalImagesPullingTime="3.94413335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:36.179837759 +0000 UTC m=+414.666761657" watchObservedRunningTime="2026-09-11 18:55:36.182338997 +0000 UTC m=+414.669262877"
Sep 11 18:55:37.075408 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:37.075377    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:38.081992 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:38.081958    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-4242g"
Sep 11 18:55:39.289140 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.289105    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"]
Sep 11 18:55:39.292525 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.292508    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.295430 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.295394    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zqwbq\""
Sep 11 18:55:39.295551 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.295463    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 18:55:39.295727 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.295710    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 18:55:39.306192 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.306167    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"]
Sep 11 18:55:39.383072 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.383034    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8grs\" (UniqueName: \"kubernetes.io/projected/809a7737-1b92-47f2-9c76-c676ca0d8323-kube-api-access-c8grs\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.383223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.383089    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.383223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.383123    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/809a7737-1b92-47f2-9c76-c676ca0d8323-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.483888 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.483849    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/809a7737-1b92-47f2-9c76-c676ca0d8323-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.484050 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.483928    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8grs\" (UniqueName: \"kubernetes.io/projected/809a7737-1b92-47f2-9c76-c676ca0d8323-kube-api-access-c8grs\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.484050 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.483966    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.484124 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:39.484059    2587 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 18:55:39.484158 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:39.484124    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert podName:809a7737-1b92-47f2-9c76-c676ca0d8323 nodeName:}" failed. No retries permitted until 2026-09-11 18:55:39.98410722 +0000 UTC m=+418.471031082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-dvflc" (UID: "809a7737-1b92-47f2-9c76-c676ca0d8323") : secret "plugin-serving-cert" not found
Sep 11 18:55:39.484550 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.484531    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/809a7737-1b92-47f2-9c76-c676ca0d8323-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.498873 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.498848    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8grs\" (UniqueName: \"kubernetes.io/projected/809a7737-1b92-47f2-9c76-c676ca0d8323-kube-api-access-c8grs\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.988518 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.988480    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:39.991052 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:39.991024    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/809a7737-1b92-47f2-9c76-c676ca0d8323-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dvflc\" (UID: \"809a7737-1b92-47f2-9c76-c676ca0d8323\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:40.201690 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:40.201653    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"
Sep 11 18:55:40.504307 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:40.504278    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc"]
Sep 11 18:55:40.506590 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:40.506560    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod809a7737_1b92_47f2_9c76_c676ca0d8323.slice/crio-4fc695479c78b5cee9f6c0625e88f368775c79c46792a563a8eacd620eea865f WatchSource:0}: Error finding container 4fc695479c78b5cee9f6c0625e88f368775c79c46792a563a8eacd620eea865f: Status 404 returned error can't find the container with id 4fc695479c78b5cee9f6c0625e88f368775c79c46792a563a8eacd620eea865f
Sep 11 18:55:41.100291 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:41.100257    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dnbqd"
Sep 11 18:55:41.161154 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:41.161113    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc" event={"ID":"809a7737-1b92-47f2-9c76-c676ca0d8323","Type":"ContainerStarted","Data":"4fc695479c78b5cee9f6c0625e88f368775c79c46792a563a8eacd620eea865f"}
Sep 11 18:55:45.186139 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:45.186103    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc" event={"ID":"809a7737-1b92-47f2-9c76-c676ca0d8323","Type":"ContainerStarted","Data":"5c8e6c1782e0439ad7a8e8344dd69935fea2b74094ad3b9c3df1a83a9610708e"}
Sep 11 18:55:45.217030 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:45.216977    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dvflc" podStartSLOduration=1.6369312040000001 podStartE2EDuration="6.216935147s" totalImagesPullingTime="4.580003943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:45.216318242 +0000 UTC m=+423.703242122" watchObservedRunningTime="2026-09-11 18:55:45.216935147 +0000 UTC m=+423.703859026"
Sep 11 18:55:47.140440 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:47.140403    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.497261 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.497224    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"]
Sep 11 18:55:49.497753 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.497420    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" containerName="manager" containerID="cri-o://b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f" gracePeriod=2
Sep 11 18:55:49.513344 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.513302    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"]
Sep 11 18:55:49.546459 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.546423    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"]
Sep 11 18:55:49.546661 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.546636    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm" podUID="55883c84-489c-4407-b408-c810c178cb00" containerName="manager" containerID="cri-o://42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4" gracePeriod=2
Sep 11 18:55:49.569056 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.569006    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"]
Sep 11 18:55:49.583113 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583088    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:55:49.583447 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583434    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" containerName="manager"
Sep 11 18:55:49.583492 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583449    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" containerName="manager"
Sep 11 18:55:49.583492 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583462    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55883c84-489c-4407-b408-c810c178cb00" containerName="manager"
Sep 11 18:55:49.583492 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583467    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="55883c84-489c-4407-b408-c810c178cb00" containerName="manager"
Sep 11 18:55:49.583719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583527    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="55883c84-489c-4407-b408-c810c178cb00" containerName="manager"
Sep 11 18:55:49.583719 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.583536    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" containerName="manager"
Sep 11 18:55:49.586579 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.586560    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.592864 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.592829    2587 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"55883c84-489c-4407-b408-c810c178cb00\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-h89sm\": pods \"limitador-operator-controller-manager-74495c69f8-h89sm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.597797 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.597756    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.665463 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.665430    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"]
Sep 11 18:55:49.669101 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.669073    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:49.669292 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.669123    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:55:49.681744 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.681710    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.681895 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.681780    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prhb\" (UniqueName: \"kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.708432 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.708384    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h89sm\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="55883c84-489c-4407-b408-c810c178cb00" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.711703 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.711666    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.712869 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.712846    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"]
Sep 11 18:55:49.716135 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.716098    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.759552 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.759463    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h89sm\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="55883c84-489c-4407-b408-c810c178cb00" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.783003 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.782959    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.783168 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.783011    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75p45\" (UniqueName: \"kubernetes.io/projected/4d063ff1-28f6-4aab-86af-8ad361aa6e10-kube-api-access-75p45\") pod \"limitador-operator-controller-manager-74495c69f8-hvqvk\" (UID: \"4d063ff1-28f6-4aab-86af-8ad361aa6e10\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:49.783168 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.783043    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6prhb\" (UniqueName: \"kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.783463 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.783438    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.802474 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.802446    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prhb\" (UniqueName: \"kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ltsvg\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.820193 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.820167    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.822150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.822132    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.822557 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.822537    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h89sm\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="55883c84-489c-4407-b408-c810c178cb00" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.824291 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.824270    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.826586 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.826565    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-h89sm\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="55883c84-489c-4407-b408-c810c178cb00" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:49.834219 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:49.834199    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-qm6p7\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:49.883900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.883862    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86jll\" (UniqueName: \"kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll\") pod \"6f9364e9-18a8-4bb7-bb15-353d705af891\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") "
Sep 11 18:55:49.884070 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.883920    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume\") pod \"6f9364e9-18a8-4bb7-bb15-353d705af891\" (UID: \"6f9364e9-18a8-4bb7-bb15-353d705af891\") "
Sep 11 18:55:49.884124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.884075    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75p45\" (UniqueName: \"kubernetes.io/projected/4d063ff1-28f6-4aab-86af-8ad361aa6e10-kube-api-access-75p45\") pod \"limitador-operator-controller-manager-74495c69f8-hvqvk\" (UID: \"4d063ff1-28f6-4aab-86af-8ad361aa6e10\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:49.884301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.884277    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f9364e9-18a8-4bb7-bb15-353d705af891" (UID: "6f9364e9-18a8-4bb7-bb15-353d705af891"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:55:49.886132 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.886107    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll" (OuterVolumeSpecName: "kube-api-access-86jll") pod "6f9364e9-18a8-4bb7-bb15-353d705af891" (UID: "6f9364e9-18a8-4bb7-bb15-353d705af891"). InnerVolumeSpecName "kube-api-access-86jll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:49.900642 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.900610    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75p45\" (UniqueName: \"kubernetes.io/projected/4d063ff1-28f6-4aab-86af-8ad361aa6e10-kube-api-access-75p45\") pod \"limitador-operator-controller-manager-74495c69f8-hvqvk\" (UID: \"4d063ff1-28f6-4aab-86af-8ad361aa6e10\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:49.955540 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.955499    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:49.983800 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.983751    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:49.984977 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.984948    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tgms\" (UniqueName: \"kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms\") pod \"55883c84-489c-4407-b408-c810c178cb00\" (UID: \"55883c84-489c-4407-b408-c810c178cb00\") "
Sep 11 18:55:49.985315 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.985294    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86jll\" (UniqueName: \"kubernetes.io/projected/6f9364e9-18a8-4bb7-bb15-353d705af891-kube-api-access-86jll\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:49.985381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.985321    2587 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9364e9-18a8-4bb7-bb15-353d705af891-extensions-socket-volume\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:49.986897 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.986873    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms" (OuterVolumeSpecName: "kube-api-access-7tgms") pod "55883c84-489c-4407-b408-c810c178cb00" (UID: "55883c84-489c-4407-b408-c810c178cb00"). InnerVolumeSpecName "kube-api-access-7tgms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:49.995967 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.995941    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55883c84-489c-4407-b408-c810c178cb00" path="/var/lib/kubelet/pods/55883c84-489c-4407-b408-c810c178cb00/volumes"
Sep 11 18:55:49.996285 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:49.996271    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9364e9-18a8-4bb7-bb15-353d705af891" path="/var/lib/kubelet/pods/6f9364e9-18a8-4bb7-bb15-353d705af891/volumes"
Sep 11 18:55:50.086098 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.086053    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tgms\" (UniqueName: \"kubernetes.io/projected/55883c84-489c-4407-b408-c810c178cb00-kube-api-access-7tgms\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:50.217875 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.217839    2587 generic.go:356] "Generic (PLEG): container finished" podID="6f9364e9-18a8-4bb7-bb15-353d705af891" containerID="b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f" exitCode=0
Sep 11 18:55:50.218034 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.217886    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-qm6p7"
Sep 11 18:55:50.218034 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.217942    2587 scope.go:117] "RemoveContainer" containerID="b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f"
Sep 11 18:55:50.219588 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.219559    2587 generic.go:356] "Generic (PLEG): container finished" podID="55883c84-489c-4407-b408-c810c178cb00" containerID="42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4" exitCode=0
Sep 11 18:55:50.219708 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.219629    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-h89sm"
Sep 11 18:55:50.227370 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.227347    2587 scope.go:117] "RemoveContainer" containerID="b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f"
Sep 11 18:55:50.227703 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:50.227677    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f\": container with ID starting with b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f not found: ID does not exist" containerID="b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f"
Sep 11 18:55:50.227788 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.227714    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f"} err="failed to get container status \"b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f\": rpc error: code = NotFound desc = could not find container \"b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f\": container with ID starting with b2a5f759d7d09688808e28c73f011569c8a6c052193215f80d6f84858c8f5a4f not found: ID does not exist"
Sep 11 18:55:50.227788 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.227741    2587 scope.go:117] "RemoveContainer" containerID="42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4"
Sep 11 18:55:50.235955 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.235937    2587 scope.go:117] "RemoveContainer" containerID="42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4"
Sep 11 18:55:50.236273 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:50.236254    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4\": container with ID starting with 42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4 not found: ID does not exist" containerID="42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4"
Sep 11 18:55:50.236348 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.236279    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4"} err="failed to get container status \"42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4\": rpc error: code = NotFound desc = could not find container \"42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4\": container with ID starting with 42538f0994d71c5083a9c085241289b3a0a58f28ca36fc0dfd3e11fc3f0eebe4 not found: ID does not exist"
Sep 11 18:55:50.254029 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.254002    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:55:50.255238 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:50.255208    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9c783a_06ac_4a86_acc6_cf0537120c09.slice/crio-7b8762e0183b4b403337df2b8fe19f899fe1fb9cfed5634231fe24d7033c84c4 WatchSource:0}: Error finding container 7b8762e0183b4b403337df2b8fe19f899fe1fb9cfed5634231fe24d7033c84c4: Status 404 returned error can't find the container with id 7b8762e0183b4b403337df2b8fe19f899fe1fb9cfed5634231fe24d7033c84c4
Sep 11 18:55:50.284397 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:50.283950    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"]
Sep 11 18:55:50.287668 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:55:50.287639    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d063ff1_28f6_4aab_86af_8ad361aa6e10.slice/crio-6630115b063580a80b33903ad4e1a5580fb13ba126695634e8d6779af2986a93 WatchSource:0}: Error finding container 6630115b063580a80b33903ad4e1a5580fb13ba126695634e8d6779af2986a93: Status 404 returned error can't find the container with id 6630115b063580a80b33903ad4e1a5580fb13ba126695634e8d6779af2986a93
Sep 11 18:55:51.226490 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.226452    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk" event={"ID":"4d063ff1-28f6-4aab-86af-8ad361aa6e10","Type":"ContainerStarted","Data":"1fc7d340124a2c6043dee16257115a95e14540e71f5f6261878ec81cb14dcd4c"}
Sep 11 18:55:51.227000 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.226510    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk" event={"ID":"4d063ff1-28f6-4aab-86af-8ad361aa6e10","Type":"ContainerStarted","Data":"6630115b063580a80b33903ad4e1a5580fb13ba126695634e8d6779af2986a93"}
Sep 11 18:55:51.227000 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.226543    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:55:51.229178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.229141    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" event={"ID":"fc9c783a-06ac-4a86-acc6-cf0537120c09","Type":"ContainerStarted","Data":"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"}
Sep 11 18:55:51.229323 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.229200    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" event={"ID":"fc9c783a-06ac-4a86-acc6-cf0537120c09","Type":"ContainerStarted","Data":"7b8762e0183b4b403337df2b8fe19f899fe1fb9cfed5634231fe24d7033c84c4"}
Sep 11 18:55:51.229323 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.229231    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:55:51.246337 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.246283    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk" podStartSLOduration=2.246267682 podStartE2EDuration="2.246267682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:51.24461901 +0000 UTC m=+429.731542879" watchObservedRunningTime="2026-09-11 18:55:51.246267682 +0000 UTC m=+429.733191560"
Sep 11 18:55:51.270033 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:51.269968    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" podStartSLOduration=2.269949606 podStartE2EDuration="2.269949606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:55:51.265714702 +0000 UTC m=+429.752638573" watchObservedRunningTime="2026-09-11 18:55:51.269949606 +0000 UTC m=+429.756873485"
Sep 11 18:55:57.204105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.204037    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cc97dd57c-jxtgn" podUID="0ce7d636-646d-4fed-9006-fff5a838ea98" containerName="console" containerID="cri-o://ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded" gracePeriod=15
Sep 11 18:55:57.461221 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.461155    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:55:57.548378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548347    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cqtx\" (UniqueName: \"kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548424    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548469    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548527    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548710 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548556    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548710 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548582    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.548710 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.548635    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config\") pod \"0ce7d636-646d-4fed-9006-fff5a838ea98\" (UID: \"0ce7d636-646d-4fed-9006-fff5a838ea98\") "
Sep 11 18:55:57.549124 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.549093    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:55:57.549271 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.549126    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:55:57.549271 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.549194    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config" (OuterVolumeSpecName: "console-config") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:55:57.549355 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.549275    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:55:57.550586 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.550563    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx" (OuterVolumeSpecName: "kube-api-access-7cqtx") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "kube-api-access-7cqtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:55:57.551115 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.551097    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:55:57.551213 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.551121    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ce7d636-646d-4fed-9006-fff5a838ea98" (UID: "0ce7d636-646d-4fed-9006-fff5a838ea98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:55:57.650171 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650125    2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650171 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650168    2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-trusted-ca-bundle\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650184    2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-oauth-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650196    2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-console-config\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650209    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cqtx\" (UniqueName: \"kubernetes.io/projected/0ce7d636-646d-4fed-9006-fff5a838ea98-kube-api-access-7cqtx\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650222    2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ce7d636-646d-4fed-9006-fff5a838ea98-console-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:57.650378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:57.650236    2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ce7d636-646d-4fed-9006-fff5a838ea98-oauth-serving-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:55:58.272467 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.272377    2587 generic.go:356] "Generic (PLEG): container finished" podID="0ce7d636-646d-4fed-9006-fff5a838ea98" containerID="ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded" exitCode=0
Sep 11 18:55:58.272467 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.272433    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc97dd57c-jxtgn"
Sep 11 18:55:58.272964 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.272464    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc97dd57c-jxtgn" event={"ID":"0ce7d636-646d-4fed-9006-fff5a838ea98","Type":"ContainerDied","Data":"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"}
Sep 11 18:55:58.272964 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.272520    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc97dd57c-jxtgn" event={"ID":"0ce7d636-646d-4fed-9006-fff5a838ea98","Type":"ContainerDied","Data":"69562a2fbb7e0dc78e72be33ef8b3eae4984f726775ffb76450721a65e42ebdc"}
Sep 11 18:55:58.272964 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.272548    2587 scope.go:117] "RemoveContainer" containerID="ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"
Sep 11 18:55:58.282068 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.282048    2587 scope.go:117] "RemoveContainer" containerID="ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"
Sep 11 18:55:58.282361 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:55:58.282338    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded\": container with ID starting with ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded not found: ID does not exist" containerID="ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"
Sep 11 18:55:58.282431 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.282376    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded"} err="failed to get container status \"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded\": rpc error: code = NotFound desc = could not find container \"ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded\": container with ID starting with ca5f1d6afc8715136f3d5a19054a6d1006f434544765faf1e0f6c61057835ded not found: ID does not exist"
Sep 11 18:55:58.294335 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.294304    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:55:58.297182 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:58.297155    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc97dd57c-jxtgn"]
Sep 11 18:55:59.996085 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:55:59.996051    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce7d636-646d-4fed-9006-fff5a838ea98" path="/var/lib/kubelet/pods/0ce7d636-646d-4fed-9006-fff5a838ea98/volumes"
Sep 11 18:56:02.238541 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:02.238501    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hvqvk"
Sep 11 18:56:02.239006 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:02.238645    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:56:07.325074 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.324982    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:56:07.325524 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.325205    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" podUID="fc9c783a-06ac-4a86-acc6-cf0537120c09" containerName="manager" containerID="cri-o://e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda" gracePeriod=10
Sep 11 18:56:07.624659 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.624625    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:56:07.739543 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.739507    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume\") pod \"fc9c783a-06ac-4a86-acc6-cf0537120c09\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") "
Sep 11 18:56:07.739769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.739625    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6prhb\" (UniqueName: \"kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb\") pod \"fc9c783a-06ac-4a86-acc6-cf0537120c09\" (UID: \"fc9c783a-06ac-4a86-acc6-cf0537120c09\") "
Sep 11 18:56:07.741994 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.740024    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc9c783a-06ac-4a86-acc6-cf0537120c09" (UID: "fc9c783a-06ac-4a86-acc6-cf0537120c09"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 18:56:07.741994 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.740454    2587 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9c783a-06ac-4a86-acc6-cf0537120c09-extensions-socket-volume\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:56:07.746088 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.742568    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb" (OuterVolumeSpecName: "kube-api-access-6prhb") pod "fc9c783a-06ac-4a86-acc6-cf0537120c09" (UID: "fc9c783a-06ac-4a86-acc6-cf0537120c09"). InnerVolumeSpecName "kube-api-access-6prhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:56:07.841172 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:07.841078    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6prhb\" (UniqueName: \"kubernetes.io/projected/fc9c783a-06ac-4a86-acc6-cf0537120c09-kube-api-access-6prhb\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:56:08.332521 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.332480    2587 generic.go:356] "Generic (PLEG): container finished" podID="fc9c783a-06ac-4a86-acc6-cf0537120c09" containerID="e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda" exitCode=0
Sep 11 18:56:08.332980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.332528    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" event={"ID":"fc9c783a-06ac-4a86-acc6-cf0537120c09","Type":"ContainerDied","Data":"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"}
Sep 11 18:56:08.332980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.332541    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"
Sep 11 18:56:08.332980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.332579    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg" event={"ID":"fc9c783a-06ac-4a86-acc6-cf0537120c09","Type":"ContainerDied","Data":"7b8762e0183b4b403337df2b8fe19f899fe1fb9cfed5634231fe24d7033c84c4"}
Sep 11 18:56:08.332980 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.332628    2587 scope.go:117] "RemoveContainer" containerID="e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"
Sep 11 18:56:08.341421 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.341401    2587 scope.go:117] "RemoveContainer" containerID="e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"
Sep 11 18:56:08.341743 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:56:08.341721    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda\": container with ID starting with e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda not found: ID does not exist" containerID="e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"
Sep 11 18:56:08.341821 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.341754    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda"} err="failed to get container status \"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda\": rpc error: code = NotFound desc = could not find container \"e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda\": container with ID starting with e49b44f71dc5101c2d40041a9cadfbe6c65a76a2e613105c0111a83b7cf73cda not found: ID does not exist"
Sep 11 18:56:08.353637 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.353589    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:56:08.359879 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:08.359854    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ltsvg"]
Sep 11 18:56:09.995432 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:09.995395    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9c783a-06ac-4a86-acc6-cf0537120c09" path="/var/lib/kubelet/pods/fc9c783a-06ac-4a86-acc6-cf0537120c09/volumes"
Sep 11 18:56:23.601327 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601294    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"]
Sep 11 18:56:23.601846 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601828    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9c783a-06ac-4a86-acc6-cf0537120c09" containerName="manager"
Sep 11 18:56:23.601846 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601848    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9c783a-06ac-4a86-acc6-cf0537120c09" containerName="manager"
Sep 11 18:56:23.602093 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601880    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce7d636-646d-4fed-9006-fff5a838ea98" containerName="console"
Sep 11 18:56:23.602093 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601887    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce7d636-646d-4fed-9006-fff5a838ea98" containerName="console"
Sep 11 18:56:23.602093 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601946    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9c783a-06ac-4a86-acc6-cf0537120c09" containerName="manager"
Sep 11 18:56:23.602093 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.601958    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce7d636-646d-4fed-9006-fff5a838ea98" containerName="console"
Sep 11 18:56:23.623187 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.623152    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"]
Sep 11 18:56:23.623344 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.623270    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.625482 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.625459    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 18:56:23.625645 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.625463    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rvtw8\""
Sep 11 18:56:23.655587 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655553    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655587 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655615    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7rdw\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-kube-api-access-j7rdw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655799 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655682    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655799 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655723    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655799 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655770    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655801    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655825    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b00b2084-00b6-490f-b5a4-35471d995f5c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655857    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.655900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.655881    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.756931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.756896    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.756931 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.756929    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7rdw\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-kube-api-access-j7rdw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.756950    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757051    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757099    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757125    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757156    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b00b2084-00b6-490f-b5a4-35471d995f5c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757419 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757210    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757419 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757246    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757419 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757305    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757565 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757418    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757565 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757523    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.757747 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.757727    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.758073 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.758051    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b00b2084-00b6-490f-b5a4-35471d995f5c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.759393 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.759369    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.759533 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.759515    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.764209 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.764179    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.764396 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.764375    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7rdw\" (UniqueName: \"kubernetes.io/projected/b00b2084-00b6-490f-b5a4-35471d995f5c-kube-api-access-j7rdw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-8thv6\" (UID: \"b00b2084-00b6-490f-b5a4-35471d995f5c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:23.933322 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:23.933288    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:24.208481 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:24.208452    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"]
Sep 11 18:56:24.210532 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:56:24.210506    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00b2084_00b6_490f_b5a4_35471d995f5c.slice/crio-30814eb9505e02f3f1003098a46e3df7a8576afe655c2107d3bf077109a5d7df WatchSource:0}: Error finding container 30814eb9505e02f3f1003098a46e3df7a8576afe655c2107d3bf077109a5d7df: Status 404 returned error can't find the container with id 30814eb9505e02f3f1003098a46e3df7a8576afe655c2107d3bf077109a5d7df
Sep 11 18:56:24.420684 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:24.420647    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" event={"ID":"b00b2084-00b6-490f-b5a4-35471d995f5c","Type":"ContainerStarted","Data":"30814eb9505e02f3f1003098a46e3df7a8576afe655c2107d3bf077109a5d7df"}
Sep 11 18:56:26.998733 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:26.998691    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:56:26.999021 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:26.998770    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:56:26.999021 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:26.998802    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:56:27.441217 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:27.441176    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" event={"ID":"b00b2084-00b6-490f-b5a4-35471d995f5c","Type":"ContainerStarted","Data":"84e1bb1f1647bbe5d451ae05706e288cb8410c510e3743c2f1e72194871d5aed"}
Sep 11 18:56:27.462753 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:27.462704    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podStartSLOduration=1.677322636 podStartE2EDuration="4.462688175s" totalImagesPullingTime="2.785365539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:27.460501089 +0000 UTC m=+465.947424969" watchObservedRunningTime="2026-09-11 18:56:27.462688175 +0000 UTC m=+465.949612053"
Sep 11 18:56:27.933824 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:27.933785    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:28.435695 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.435661    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:28.439303 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.439283    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.441634 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.441608    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 18:56:28.447641 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.447383    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:28.500280 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.500244    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.500660 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.500633    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxrh\" (UniqueName: \"kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.537436 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.537399    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:28.601174 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.601129    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.601366 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.601188    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxrh\" (UniqueName: \"kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.601794 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.601773    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.609031 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.609003    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxrh\" (UniqueName: \"kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh\") pod \"limitador-limitador-8588749977-5fnfd\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") " pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.730668 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.730549    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:56:28.734385 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.734360    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.742443 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.742417    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:56:28.751855 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.751826    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:28.773255 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.773221    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:56:28.804113 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.803671    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9d06e40-0b8a-4920-948e-0a2b4758f904-config-file\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.804113 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.803853    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5k7\" (UniqueName: \"kubernetes.io/projected/f9d06e40-0b8a-4920-948e-0a2b4758f904-kube-api-access-2p5k7\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.904716 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.904674    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5k7\" (UniqueName: \"kubernetes.io/projected/f9d06e40-0b8a-4920-948e-0a2b4758f904-kube-api-access-2p5k7\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.904923 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.904771    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9d06e40-0b8a-4920-948e-0a2b4758f904-config-file\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.905419 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.905398    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9d06e40-0b8a-4920-948e-0a2b4758f904-config-file\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.912474 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.912450    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5k7\" (UniqueName: \"kubernetes.io/projected/f9d06e40-0b8a-4920-948e-0a2b4758f904-kube-api-access-2p5k7\") pod \"limitador-limitador-84994f7ffc-fhcph\" (UID: \"f9d06e40-0b8a-4920-948e-0a2b4758f904\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:28.939293 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:28.939262    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:29.025470 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.025437    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:29.026713 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:56:29.026689    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ba7026_cf0f_4942_b0f0_fed8cdc9bec4.slice/crio-9394242deb1f88250e6c71b39b6b52ded14862b6d30df88b5aba7da0bee60ca3 WatchSource:0}: Error finding container 9394242deb1f88250e6c71b39b6b52ded14862b6d30df88b5aba7da0bee60ca3: Status 404 returned error can't find the container with id 9394242deb1f88250e6c71b39b6b52ded14862b6d30df88b5aba7da0bee60ca3
Sep 11 18:56:29.045840 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.045812    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:29.325529 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.325502    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:56:29.327657 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:56:29.327588    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d06e40_0b8a_4920_948e_0a2b4758f904.slice/crio-fe66aed4675978301e46cea0f1d9d22e70340be7ce5cb925fe472c6319f570dc WatchSource:0}: Error finding container fe66aed4675978301e46cea0f1d9d22e70340be7ce5cb925fe472c6319f570dc: Status 404 returned error can't find the container with id fe66aed4675978301e46cea0f1d9d22e70340be7ce5cb925fe472c6319f570dc
Sep 11 18:56:29.454890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.454850    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph" event={"ID":"f9d06e40-0b8a-4920-948e-0a2b4758f904","Type":"ContainerStarted","Data":"fe66aed4675978301e46cea0f1d9d22e70340be7ce5cb925fe472c6319f570dc"}
Sep 11 18:56:29.456205 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.456179    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" event={"ID":"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4","Type":"ContainerStarted","Data":"9394242deb1f88250e6c71b39b6b52ded14862b6d30df88b5aba7da0bee60ca3"}
Sep 11 18:56:29.456470 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.456459    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:29.457423 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:29.457408    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:56:31.469698 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.469657    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph" event={"ID":"f9d06e40-0b8a-4920-948e-0a2b4758f904","Type":"ContainerStarted","Data":"9249c88cc1881c4580e7ada1505f3b8c31983f026fa0dc05189cf3cccbd7af6c"}
Sep 11 18:56:31.470129 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.469766    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:31.471435 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.471408    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" event={"ID":"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4","Type":"ContainerStarted","Data":"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"}
Sep 11 18:56:31.471655 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.471635    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:31.489012 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.488955    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph" podStartSLOduration=1.570372087 podStartE2EDuration="3.488939865s" totalImagesPullingTime="1.918567778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:31.486817524 +0000 UTC m=+469.973741403" watchObservedRunningTime="2026-09-11 18:56:31.488939865 +0000 UTC m=+469.975863740"
Sep 11 18:56:31.503535 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:31.503441    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" podStartSLOduration=1.705597562 podStartE2EDuration="3.503425517s" totalImagesPullingTime="1.797827955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:56:31.502148766 +0000 UTC m=+469.989072645" watchObservedRunningTime="2026-09-11 18:56:31.503425517 +0000 UTC m=+469.990349395"
Sep 11 18:56:42.478584 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:42.478550    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:42.479062 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:42.478777    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhcph"
Sep 11 18:56:42.537014 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:42.536978    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:42.537181 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:42.537145    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" podUID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" containerName="limitador" containerID="cri-o://a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295" gracePeriod=30
Sep 11 18:56:43.082845 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.082820    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:43.131580 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.131492    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kxrh\" (UniqueName: \"kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh\") pod \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") "
Sep 11 18:56:43.131749 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.131648    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file\") pod \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\" (UID: \"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4\") "
Sep 11 18:56:43.132339 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.132007    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file" (OuterVolumeSpecName: "config-file") pod "39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" (UID: "39ba7026-cf0f-4942-b0f0-fed8cdc9bec4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 18:56:43.132339 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.132147    2587 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-config-file\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:56:43.133608 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.133575    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh" (OuterVolumeSpecName: "kube-api-access-5kxrh") pod "39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" (UID: "39ba7026-cf0f-4942-b0f0-fed8cdc9bec4"). InnerVolumeSpecName "kube-api-access-5kxrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:56:43.233338 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.233287    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kxrh\" (UniqueName: \"kubernetes.io/projected/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4-kube-api-access-5kxrh\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:56:43.540105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.540069    2587 generic.go:356] "Generic (PLEG): container finished" podID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" containerID="a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295" exitCode=0
Sep 11 18:56:43.540570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.540123    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd"
Sep 11 18:56:43.540570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.540152    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" event={"ID":"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4","Type":"ContainerDied","Data":"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"}
Sep 11 18:56:43.540570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.540205    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5fnfd" event={"ID":"39ba7026-cf0f-4942-b0f0-fed8cdc9bec4","Type":"ContainerDied","Data":"9394242deb1f88250e6c71b39b6b52ded14862b6d30df88b5aba7da0bee60ca3"}
Sep 11 18:56:43.540570 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.540227    2587 scope.go:117] "RemoveContainer" containerID="a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"
Sep 11 18:56:43.549737 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.549718    2587 scope.go:117] "RemoveContainer" containerID="a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"
Sep 11 18:56:43.550035 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:56:43.550015    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295\": container with ID starting with a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295 not found: ID does not exist" containerID="a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"
Sep 11 18:56:43.550130 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.550041    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295"} err="failed to get container status \"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295\": rpc error: code = NotFound desc = could not find container \"a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295\": container with ID starting with a5983765fe143955479e71341e4a31d0a98a3a93d9e6af062141d56146b05295 not found: ID does not exist"
Sep 11 18:56:43.561335 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.561308    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:43.565020 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.564990    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5fnfd"]
Sep 11 18:56:43.995450 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:43.995419    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" path="/var/lib/kubelet/pods/39ba7026-cf0f-4942-b0f0-fed8cdc9bec4/volumes"
Sep 11 18:56:58.318673 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.318635    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 18:56:58.319156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.318996    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" containerName="limitador"
Sep 11 18:56:58.319156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.319007    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" containerName="limitador"
Sep 11 18:56:58.319156 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.319095    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="39ba7026-cf0f-4942-b0f0-fed8cdc9bec4" containerName="limitador"
Sep 11 18:56:58.324060 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.324035    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.326769 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.326750    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 18:56:58.326877 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.326750    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6x5h8\""
Sep 11 18:56:58.330632 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.330582    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 18:56:58.471525 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.471485    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px66b\" (UniqueName: \"kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.471750 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.471541    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.572458 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.572352    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px66b\" (UniqueName: \"kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.572458 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.572413    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.574926 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.574900    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.580381 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.580349    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px66b\" (UniqueName: \"kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b\") pod \"authorino-559dbb645d-bmzwm\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") " pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.634562 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.634530    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 18:56:58.904325 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:58.904286    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 18:56:58.905938 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:56:58.905912    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf820cff_43ac_491c_aba0_e0126cd574b9.slice/crio-bd76a2938c20f2acfb521a704973be85f4e11fc892103e003830b4a04a506a54 WatchSource:0}: Error finding container bd76a2938c20f2acfb521a704973be85f4e11fc892103e003830b4a04a506a54: Status 404 returned error can't find the container with id bd76a2938c20f2acfb521a704973be85f4e11fc892103e003830b4a04a506a54
Sep 11 18:56:59.632658 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:56:59.632616    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559dbb645d-bmzwm" event={"ID":"bf820cff-43ac-491c-aba0-e0126cd574b9","Type":"ContainerStarted","Data":"bd76a2938c20f2acfb521a704973be85f4e11fc892103e003830b4a04a506a54"}
Sep 11 18:57:00.640190 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:00.640151    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559dbb645d-bmzwm" event={"ID":"bf820cff-43ac-491c-aba0-e0126cd574b9","Type":"ContainerStarted","Data":"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"}
Sep 11 18:57:00.655006 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:00.654954    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-559dbb645d-bmzwm" podStartSLOduration=1.113169021 podStartE2EDuration="2.65493839s" totalImagesPullingTime="1.541769369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:57:00.6534283 +0000 UTC m=+499.140352181" watchObservedRunningTime="2026-09-11 18:57:00.65493839 +0000 UTC m=+499.141862267"
Sep 11 18:57:05.452115 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.452080    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:05.455361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.455336    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.457886 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.457857    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mtdfh\""
Sep 11 18:57:05.458477 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.458444    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 18:57:05.458569 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.458452    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 18:57:05.458569 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.458487    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 18:57:05.481955 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.481922    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:05.639378 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.639341    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 18:57:05.642804 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.642780    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.647020 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.646986    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.647178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.647033    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swb4r\" (UniqueName: \"kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.647178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.647104    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.653361 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.653330    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 18:57:05.748013 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.747914    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.748195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.748021    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.748195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.748045    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978mv\" (UniqueName: \"kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.748195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.748072    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.748195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.748102    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swb4r\" (UniqueName: \"kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.748195 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.748137    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.748471 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:57:05.748197    2587 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 18:57:05.748471 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:57:05.748289    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert podName:90aa1245-27eb-41b1-8619-ddd8bcefbbd8 nodeName:}" failed. No retries permitted until 2026-09-11 18:57:06.248266643 +0000 UTC m=+504.735190515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert") pod "maas-controller-8648fd79-x8894" (UID: "90aa1245-27eb-41b1-8619-ddd8bcefbbd8") : secret "maas-controller-webhook-cert" not found
Sep 11 18:57:05.750650 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.750628    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.756045 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.756019    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swb4r\" (UniqueName: \"kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:05.849193 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.849150    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.849193 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.849198    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978mv\" (UniqueName: \"kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.849425 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.849267    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.849425 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:57:05.849308    2587 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 18:57:05.849425 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:57:05.849387    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert podName:23efbbdd-c937-47c0-8b07-4d81a1a003fc nodeName:}" failed. No retries permitted until 2026-09-11 18:57:06.349371527 +0000 UTC m=+504.836295384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert") pod "maas-controller-674ff667f9-7hk52" (UID: "23efbbdd-c937-47c0-8b07-4d81a1a003fc") : secret "maas-controller-webhook-cert" not found
Sep 11 18:57:05.851744 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.851722    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:05.857496 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:05.857468    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978mv\" (UniqueName: \"kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:06.253132 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.253090    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:06.255571 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.255547    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") pod \"maas-controller-8648fd79-x8894\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") " pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:06.354157 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.354116    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:06.356534 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.356514    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") pod \"maas-controller-674ff667f9-7hk52\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") " pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:06.366561 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.366538    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:06.553268 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.553174    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:06.640900 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.640850    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:06.643771 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:57:06.643746    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90aa1245_27eb_41b1_8619_ddd8bcefbbd8.slice/crio-0f370bcd680211605e4caebb9acf25dfbd9f933589ee950b41dcba1c0c096a87 WatchSource:0}: Error finding container 0f370bcd680211605e4caebb9acf25dfbd9f933589ee950b41dcba1c0c096a87: Status 404 returned error can't find the container with id 0f370bcd680211605e4caebb9acf25dfbd9f933589ee950b41dcba1c0c096a87
Sep 11 18:57:06.674553 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.674518    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8648fd79-x8894" event={"ID":"90aa1245-27eb-41b1-8619-ddd8bcefbbd8","Type":"ContainerStarted","Data":"0f370bcd680211605e4caebb9acf25dfbd9f933589ee950b41dcba1c0c096a87"}
Sep 11 18:57:06.827676 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:06.827647    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 18:57:06.829350 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:57:06.829319    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23efbbdd_c937_47c0_8b07_4d81a1a003fc.slice/crio-4c4f6faf9bd4a54fa3be689506f9c7c1d14a904843b1e01e691f3099716e3635 WatchSource:0}: Error finding container 4c4f6faf9bd4a54fa3be689506f9c7c1d14a904843b1e01e691f3099716e3635: Status 404 returned error can't find the container with id 4c4f6faf9bd4a54fa3be689506f9c7c1d14a904843b1e01e691f3099716e3635
Sep 11 18:57:07.687442 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:07.687337    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7hk52" event={"ID":"23efbbdd-c937-47c0-8b07-4d81a1a003fc","Type":"ContainerStarted","Data":"4c4f6faf9bd4a54fa3be689506f9c7c1d14a904843b1e01e691f3099716e3635"}
Sep 11 18:57:09.701281 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.701243    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8648fd79-x8894" event={"ID":"90aa1245-27eb-41b1-8619-ddd8bcefbbd8","Type":"ContainerStarted","Data":"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"}
Sep 11 18:57:09.701807 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.701426    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:09.702825 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.702801    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7hk52" event={"ID":"23efbbdd-c937-47c0-8b07-4d81a1a003fc","Type":"ContainerStarted","Data":"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"}
Sep 11 18:57:09.702943 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.702921    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:09.717617 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.717544    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8648fd79-x8894" podStartSLOduration=2.229116429 podStartE2EDuration="4.717523621s" totalImagesPullingTime="2.488407192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:57:09.716805656 +0000 UTC m=+508.203729536" watchObservedRunningTime="2026-09-11 18:57:09.717523621 +0000 UTC m=+508.204447500"
Sep 11 18:57:09.733482 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:09.733429    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-674ff667f9-7hk52" podStartSLOduration=2.424200795 podStartE2EDuration="4.733413706s" totalImagesPullingTime="2.309212911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:57:09.732452019 +0000 UTC m=+508.219375898" watchObservedRunningTime="2026-09-11 18:57:09.733413706 +0000 UTC m=+508.220337585"
Sep 11 18:57:20.710203 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:20.710167    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:20.710637 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:20.710240    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 18:57:20.771897 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:20.771864    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:20.772615 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:20.772546    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8648fd79-x8894" podUID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" containerName="manager" containerID="cri-o://1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe" gracePeriod=30
Sep 11 18:57:21.020460 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.020433    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:21.081586 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.081556    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") pod \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") "
Sep 11 18:57:21.081773 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.081622    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swb4r\" (UniqueName: \"kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r\") pod \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") "
Sep 11 18:57:21.081773 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.081677    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs\") pod \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\" (UID: \"90aa1245-27eb-41b1-8619-ddd8bcefbbd8\") "
Sep 11 18:57:21.083812 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.083785    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r" (OuterVolumeSpecName: "kube-api-access-swb4r") pod "90aa1245-27eb-41b1-8619-ddd8bcefbbd8" (UID: "90aa1245-27eb-41b1-8619-ddd8bcefbbd8"). InnerVolumeSpecName "kube-api-access-swb4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 18:57:21.083922 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.083864    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "90aa1245-27eb-41b1-8619-ddd8bcefbbd8" (UID: "90aa1245-27eb-41b1-8619-ddd8bcefbbd8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:57:21.083963 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.083944    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "90aa1245-27eb-41b1-8619-ddd8bcefbbd8" (UID: "90aa1245-27eb-41b1-8619-ddd8bcefbbd8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 18:57:21.182890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.182855    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:57:21.182890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.182884    2587 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-webhook-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:57:21.182890 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.182894    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swb4r\" (UniqueName: \"kubernetes.io/projected/90aa1245-27eb-41b1-8619-ddd8bcefbbd8-kube-api-access-swb4r\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 18:57:21.771255 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.771219    2587 generic.go:356] "Generic (PLEG): container finished" podID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" containerID="1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe" exitCode=0
Sep 11 18:57:21.771674 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.771268    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8648fd79-x8894"
Sep 11 18:57:21.771674 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.771303    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8648fd79-x8894" event={"ID":"90aa1245-27eb-41b1-8619-ddd8bcefbbd8","Type":"ContainerDied","Data":"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"}
Sep 11 18:57:21.771674 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.771358    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8648fd79-x8894" event={"ID":"90aa1245-27eb-41b1-8619-ddd8bcefbbd8","Type":"ContainerDied","Data":"0f370bcd680211605e4caebb9acf25dfbd9f933589ee950b41dcba1c0c096a87"}
Sep 11 18:57:21.771674 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.771381    2587 scope.go:117] "RemoveContainer" containerID="1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"
Sep 11 18:57:21.781713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.781547    2587 scope.go:117] "RemoveContainer" containerID="1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"
Sep 11 18:57:21.781882 ip-10-0-134-233 kubenswrapper[2587]: E0911 18:57:21.781864    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe\": container with ID starting with 1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe not found: ID does not exist" containerID="1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"
Sep 11 18:57:21.781922 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.781892    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe"} err="failed to get container status \"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe\": rpc error: code = NotFound desc = could not find container \"1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe\": container with ID starting with 1fcc2a826e934a5557c04f3ae2feb4e4e4ed81c13d858d489673a5b42ab4c0fe not found: ID does not exist"
Sep 11 18:57:21.792559 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.792529    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:21.796057 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:21.796030    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8648fd79-x8894"]
Sep 11 18:57:22.002359 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:22.002324    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" path="/var/lib/kubelet/pods/90aa1245-27eb-41b1-8619-ddd8bcefbbd8/volumes"
Sep 11 18:57:42.437394 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.437356    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 18:57:42.437962 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.437942    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" containerName="manager"
Sep 11 18:57:42.438042 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.437965    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" containerName="manager"
Sep 11 18:57:42.438096 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.438074    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="90aa1245-27eb-41b1-8619-ddd8bcefbbd8" containerName="manager"
Sep 11 18:57:42.444093 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.444073    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.446301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.446273    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 18:57:42.446434 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.446273    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 18:57:42.446509 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.446431    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 18:57:42.447178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.447155    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6bftc\""
Sep 11 18:57:42.447178 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.447176    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 18:57:42.453789 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.453764    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 18:57:42.578716 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.578676    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jq44\" (UniqueName: \"kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.578892 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.578728    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.578892 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.578802    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.578892 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.578837    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.679993 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.679954    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.680165 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.680001    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.680165 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.680044    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jq44\" (UniqueName: \"kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.680165 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.680072    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.680854 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.680827    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.682522 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.682496    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.682672 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.682649    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.692048 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.691991    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jq44\" (UniqueName: \"kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44\") pod \"maas-api-79856dc5dd-jwn4w\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") " pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:42.755856 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:42.755824    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:43.038012 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:43.037980    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 18:57:43.039343 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:57:43.039312    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83274355_6b9f_46df_b7c5_b2e5357b1ef4.slice/crio-21110762926d8e10370481489718235ad5739582c969cabd1f189c7415e04d0c WatchSource:0}: Error finding container 21110762926d8e10370481489718235ad5739582c969cabd1f189c7415e04d0c: Status 404 returned error can't find the container with id 21110762926d8e10370481489718235ad5739582c969cabd1f189c7415e04d0c
Sep 11 18:57:43.141762 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:43.141721    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:57:43.918373 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:43.918323    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" event={"ID":"83274355-6b9f-46df-b7c5-b2e5357b1ef4","Type":"ContainerStarted","Data":"21110762926d8e10370481489718235ad5739582c969cabd1f189c7415e04d0c"}
Sep 11 18:57:45.933406 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:45.933365    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" event={"ID":"83274355-6b9f-46df-b7c5-b2e5357b1ef4","Type":"ContainerStarted","Data":"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"}
Sep 11 18:57:45.933852 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:45.933630    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:45.950859 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:45.950813    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" podStartSLOduration=1.7514249450000001 podStartE2EDuration="3.950797478s" totalImagesPullingTime="2.199372533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:57:45.949117884 +0000 UTC m=+544.436041765" watchObservedRunningTime="2026-09-11 18:57:45.950797478 +0000 UTC m=+544.437721356"
Sep 11 18:57:51.944327 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:51.944284    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 18:57:52.982057 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.982022    2587 generic.go:356] "Generic (PLEG): container finished" podID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerID="84e1bb1f1647bbe5d451ae05706e288cb8410c510e3743c2f1e72194871d5aed" exitCode=0
Sep 11 18:57:52.982467 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.982093    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" event={"ID":"b00b2084-00b6-490f-b5a4-35471d995f5c","Type":"ContainerDied","Data":"84e1bb1f1647bbe5d451ae05706e288cb8410c510e3743c2f1e72194871d5aed"}
Sep 11 18:57:52.982511 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.982493    2587 scope.go:117] "RemoveContainer" containerID="84e1bb1f1647bbe5d451ae05706e288cb8410c510e3743c2f1e72194871d5aed"
Sep 11 18:57:52.983500 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.983473    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:57:52.983560 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.983541    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:57:52.983623 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:52.983573    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 18:57:54.002751 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:54.002715    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" event={"ID":"b00b2084-00b6-490f-b5a4-35471d995f5c","Type":"ContainerStarted","Data":"b163191c905a1c3bf098b2c90c0354ae1886b903b3a8c9f39797ecb556ce8b62"}
Sep 11 18:57:54.933979 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:54.933926    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:57:54.935005 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:54.934978    2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8thv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 18:57:54.935150 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:54.935039    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podUID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 18:57:55.934052 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:55.934011    2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8thv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 18:57:55.934441 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:55.934068    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podUID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 18:57:56.934070 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:56.934033    2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8thv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 18:57:56.934454 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:56.934092    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podUID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 18:57:57.934619 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:57.934571    2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8thv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 18:57:57.934987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:57.934650    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podUID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 18:57:58.934618 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:58.934561    2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-8thv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 11 18:57:58.935000 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:58.934629    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6" podUID="b00b2084-00b6-490f-b5a4-35471d995f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 11 18:57:59.456844 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:59.456806    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:57:59.937847 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:57:59.937812    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:58:00.036480 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:00.036450    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8thv6"
Sep 11 18:58:03.940989 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.940943    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"]
Sep 11 18:58:03.944786 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.944766    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.947641 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.947578    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 18:58:03.947787 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.947640    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tgc84\""
Sep 11 18:58:03.947787 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.947685    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 18:58:03.947787 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.947702    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 18:58:03.954301 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.954278    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"]
Sep 11 18:58:03.987739 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987706    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.987739 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987737    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.987976 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987757    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.987976 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987887    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.987976 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987927    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9gw2\" (UniqueName: \"kubernetes.io/projected/09b5dd3e-51db-44c4-92f6-4ec7998de8da-kube-api-access-r9gw2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:03.988116 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:03.987983    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088742 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088700    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088742 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088739    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088764    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088826    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088859    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9gw2\" (UniqueName: \"kubernetes.io/projected/09b5dd3e-51db-44c4-92f6-4ec7998de8da-kube-api-access-r9gw2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.088987 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.088890    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.089204 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.089130    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.089274 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.089253    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.089312 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.089293    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.091223 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.091200    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b5dd3e-51db-44c4-92f6-4ec7998de8da-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.091359 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.091345    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b5dd3e-51db-44c4-92f6-4ec7998de8da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.096691 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.096660    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9gw2\" (UniqueName: \"kubernetes.io/projected/09b5dd3e-51db-44c4-92f6-4ec7998de8da-kube-api-access-r9gw2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9\" (UID: \"09b5dd3e-51db-44c4-92f6-4ec7998de8da\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.255938 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.255846    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:04.504715 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.504678    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:58:04.527059 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:04.527029    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"]
Sep 11 18:58:04.529023 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:58:04.528998    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b5dd3e_51db_44c4_92f6_4ec7998de8da.slice/crio-ebc2fa40b585c1fbc4e6895ddb8d6ec77e96881833e15ea88cfec0264fcc3370 WatchSource:0}: Error finding container ebc2fa40b585c1fbc4e6895ddb8d6ec77e96881833e15ea88cfec0264fcc3370: Status 404 returned error can't find the container with id ebc2fa40b585c1fbc4e6895ddb8d6ec77e96881833e15ea88cfec0264fcc3370
Sep 11 18:58:05.065405 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:05.065367    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9" event={"ID":"09b5dd3e-51db-44c4-92f6-4ec7998de8da","Type":"ContainerStarted","Data":"ebc2fa40b585c1fbc4e6895ddb8d6ec77e96881833e15ea88cfec0264fcc3370"}
Sep 11 18:58:06.073182 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:06.073072    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9" event={"ID":"09b5dd3e-51db-44c4-92f6-4ec7998de8da","Type":"ContainerStarted","Data":"039b51c2477870a5620c46d2a561277331f97f1cbce2dc4bbc4767e347d71104"}
Sep 11 18:58:06.089603 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:06.089534    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9" podStartSLOduration=1.938748764 podStartE2EDuration="3.089511243s" totalImagesPullingTime="1.150762479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:58:06.0880317 +0000 UTC m=+564.574955581" watchObservedRunningTime="2026-09-11 18:58:06.089511243 +0000 UTC m=+564.576435126"
Sep 11 18:58:14.256117 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:14.256075    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:14.256657 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:14.256160    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:14.268713 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:14.268683    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:15.134733 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:15.134704    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9"
Sep 11 18:58:31.719102 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:31.719054    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:58:52.211199 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:58:52.211163    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:59:01.713880 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:01.713839    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:59:04.049050 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.048961    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"]
Sep 11 18:59:04.054011 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.053982    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.056142 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.056114    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 18:59:04.062905 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.062879    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"]
Sep 11 18:59:04.143649 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143584    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.143649 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143656    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ef3426-603d-4724-9730-33cd67beae31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.143926 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143691    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bppgw\" (UniqueName: \"kubernetes.io/projected/f4ef3426-603d-4724-9730-33cd67beae31-kube-api-access-bppgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.143926 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143821    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.143926 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143897    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.144105 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.143993    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244557 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244522    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244745 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244574    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244745 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244687    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244745 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244711    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ef3426-603d-4724-9730-33cd67beae31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244745 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244735    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bppgw\" (UniqueName: \"kubernetes.io/projected/f4ef3426-603d-4724-9730-33cd67beae31-kube-api-access-bppgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.244947 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.244773    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.245047 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.245021    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.245103 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.245033    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.245145 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.245105    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.247316 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.247292    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ef3426-603d-4724-9730-33cd67beae31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.247794 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.247773    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ef3426-603d-4724-9730-33cd67beae31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.252918 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.252895    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bppgw\" (UniqueName: \"kubernetes.io/projected/f4ef3426-603d-4724-9730-33cd67beae31-kube-api-access-bppgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb\" (UID: \"f4ef3426-603d-4724-9730-33cd67beae31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.366572 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.366470    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:04.641804 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.641774    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"]
Sep 11 18:59:04.643705 ip-10-0-134-233 kubenswrapper[2587]: W0911 18:59:04.643680    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ef3426_603d_4724_9730_33cd67beae31.slice/crio-5b0903ad2491a322d384a34a7fafd509ba55f9d27fc87072c3c8503c96bc83a7 WatchSource:0}: Error finding container 5b0903ad2491a322d384a34a7fafd509ba55f9d27fc87072c3c8503c96bc83a7: Status 404 returned error can't find the container with id 5b0903ad2491a322d384a34a7fafd509ba55f9d27fc87072c3c8503c96bc83a7
Sep 11 18:59:04.645337 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:04.645312    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 18:59:05.420924 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:05.420878    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb" event={"ID":"f4ef3426-603d-4724-9730-33cd67beae31","Type":"ContainerStarted","Data":"0f76097dfd86ec5136331ed201d755ecf615de62b0e43f0a0c1bb31eb183e784"}
Sep 11 18:59:05.421366 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:05.420939    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb" event={"ID":"f4ef3426-603d-4724-9730-33cd67beae31","Type":"ContainerStarted","Data":"5b0903ad2491a322d384a34a7fafd509ba55f9d27fc87072c3c8503c96bc83a7"}
Sep 11 18:59:05.438623 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:05.438557    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb" podStartSLOduration=1.252047522 podStartE2EDuration="1.438541526s" totalImagesPullingTime="186.494004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 18:59:05.436056577 +0000 UTC m=+623.922980455" watchObservedRunningTime="2026-09-11 18:59:05.438541526 +0000 UTC m=+623.925465405"
Sep 11 18:59:06.101140 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:06.101097    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:59:13.403736 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:13.403699    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 18:59:14.367245 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:14.367203    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:14.367423 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:14.367282    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:14.385632 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:14.385578    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:14.493439 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:14.493403    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb"
Sep 11 18:59:21.512166 ip-10-0-134-233 kubenswrapper[2587]: I0911 18:59:21.512129    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:00:18.062016 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.061972    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74d98bd5cf-7b6tt"]
Sep 11 19:00:18.065503 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.065486    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.074422 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.074396    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74d98bd5cf-7b6tt"]
Sep 11 19:00:18.142998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.142956    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bdf8e8da-6ee3-436b-a417-81fda56bafef-tls-cert\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.143183 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.143049    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjx8\" (UniqueName: \"kubernetes.io/projected/bdf8e8da-6ee3-436b-a417-81fda56bafef-kube-api-access-fzjx8\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.244377 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.244335    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bdf8e8da-6ee3-436b-a417-81fda56bafef-tls-cert\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.244558 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.244436    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjx8\" (UniqueName: \"kubernetes.io/projected/bdf8e8da-6ee3-436b-a417-81fda56bafef-kube-api-access-fzjx8\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.246827 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.246798    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bdf8e8da-6ee3-436b-a417-81fda56bafef-tls-cert\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.252055 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.252029    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjx8\" (UniqueName: \"kubernetes.io/projected/bdf8e8da-6ee3-436b-a417-81fda56bafef-kube-api-access-fzjx8\") pod \"authorino-74d98bd5cf-7b6tt\" (UID: \"bdf8e8da-6ee3-436b-a417-81fda56bafef\") " pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.376292 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.376199    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74d98bd5cf-7b6tt"
Sep 11 19:00:18.646174 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.646146    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74d98bd5cf-7b6tt"]
Sep 11 19:00:18.648260 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:18.648231    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdf8e8da_6ee3_436b_a417_81fda56bafef.slice/crio-317219c591fbeb63b820d6aee1554879c91308d250b2f19a1dcf1676a2253ee4 WatchSource:0}: Error finding container 317219c591fbeb63b820d6aee1554879c91308d250b2f19a1dcf1676a2253ee4: Status 404 returned error can't find the container with id 317219c591fbeb63b820d6aee1554879c91308d250b2f19a1dcf1676a2253ee4
Sep 11 19:00:18.842747 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:18.842715    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74d98bd5cf-7b6tt" event={"ID":"bdf8e8da-6ee3-436b-a417-81fda56bafef","Type":"ContainerStarted","Data":"317219c591fbeb63b820d6aee1554879c91308d250b2f19a1dcf1676a2253ee4"}
Sep 11 19:00:19.853376 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:19.853335    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74d98bd5cf-7b6tt" event={"ID":"bdf8e8da-6ee3-436b-a417-81fda56bafef","Type":"ContainerStarted","Data":"bfceaff44edbd8e83a46d2e42ea326f9eeb0cb30f2ae975f714e10bd543d511a"}
Sep 11 19:00:19.873276 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:19.873211    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74d98bd5cf-7b6tt" podStartSLOduration=1.116522927 podStartE2EDuration="1.873193698s" totalImagesPullingTime="756.670771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:19.870187619 +0000 UTC m=+698.357111500" watchObservedRunningTime="2026-09-11 19:00:19.873193698 +0000 UTC m=+698.360117614"
Sep 11 19:00:19.897626 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:19.897570    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 19:00:19.898261 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:19.898205    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-559dbb645d-bmzwm" podUID="bf820cff-43ac-491c-aba0-e0126cd574b9" containerName="authorino" containerID="cri-o://1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72" gracePeriod=30
Sep 11 19:00:20.163070 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.163040    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 19:00:20.262427 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.262390    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px66b\" (UniqueName: \"kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b\") pod \"bf820cff-43ac-491c-aba0-e0126cd574b9\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") "
Sep 11 19:00:20.262616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.262444    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert\") pod \"bf820cff-43ac-491c-aba0-e0126cd574b9\" (UID: \"bf820cff-43ac-491c-aba0-e0126cd574b9\") "
Sep 11 19:00:20.264633 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.264587    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b" (OuterVolumeSpecName: "kube-api-access-px66b") pod "bf820cff-43ac-491c-aba0-e0126cd574b9" (UID: "bf820cff-43ac-491c-aba0-e0126cd574b9"). InnerVolumeSpecName "kube-api-access-px66b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:00:20.274508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.274477    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf820cff-43ac-491c-aba0-e0126cd574b9" (UID: "bf820cff-43ac-491c-aba0-e0126cd574b9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:00:20.363807 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.363767    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px66b\" (UniqueName: \"kubernetes.io/projected/bf820cff-43ac-491c-aba0-e0126cd574b9-kube-api-access-px66b\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:00:20.363807 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.363804    2587 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf820cff-43ac-491c-aba0-e0126cd574b9-tls-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:00:20.860394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.860351    2587 generic.go:356] "Generic (PLEG): container finished" podID="bf820cff-43ac-491c-aba0-e0126cd574b9" containerID="1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72" exitCode=0
Sep 11 19:00:20.860887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.860396    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559dbb645d-bmzwm" event={"ID":"bf820cff-43ac-491c-aba0-e0126cd574b9","Type":"ContainerDied","Data":"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"}
Sep 11 19:00:20.860887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.860442    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-559dbb645d-bmzwm" event={"ID":"bf820cff-43ac-491c-aba0-e0126cd574b9","Type":"ContainerDied","Data":"bd76a2938c20f2acfb521a704973be85f4e11fc892103e003830b4a04a506a54"}
Sep 11 19:00:20.860887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.860461    2587 scope.go:117] "RemoveContainer" containerID="1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"
Sep 11 19:00:20.860887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.860396    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559dbb645d-bmzwm"
Sep 11 19:00:20.870351 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.870332    2587 scope.go:117] "RemoveContainer" containerID="1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"
Sep 11 19:00:20.870667 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:00:20.870649    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72\": container with ID starting with 1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72 not found: ID does not exist" containerID="1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"
Sep 11 19:00:20.870733 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.870677    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72"} err="failed to get container status \"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72\": rpc error: code = NotFound desc = could not find container \"1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72\": container with ID starting with 1a96e04f5840ffbb6ea91569c19a71a9a1560b81791b6243dc49a4b3861c9d72 not found: ID does not exist"
Sep 11 19:00:20.884655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.884618    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 19:00:20.892255 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:20.892225    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-559dbb645d-bmzwm"]
Sep 11 19:00:21.997405 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:21.997359    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf820cff-43ac-491c-aba0-e0126cd574b9" path="/var/lib/kubelet/pods/bf820cff-43ac-491c-aba0-e0126cd574b9/volumes"
Sep 11 19:00:37.363454 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.363363    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:00:37.363847 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.363837    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf820cff-43ac-491c-aba0-e0126cd574b9" containerName="authorino"
Sep 11 19:00:37.363890 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.363852    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf820cff-43ac-491c-aba0-e0126cd574b9" containerName="authorino"
Sep 11 19:00:37.363970 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.363958    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf820cff-43ac-491c-aba0-e0126cd574b9" containerName="authorino"
Sep 11 19:00:37.367170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.367147    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.374636 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.374580    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c6c610-openshift-default-dockercfg-nj8pr\""
Sep 11 19:00:37.382935 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.382909    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:00:37.520741 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.520705    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:00:37.523805 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.523771    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.523849    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.523884    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.523916    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.523979    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv47j\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.524038    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.524082    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.524108    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.524143    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.524925 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.524905    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.528293 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.528271    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-62499f-openshift-default-dockercfg-k2cqk\""
Sep 11 19:00:37.542006 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.541977    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:00:37.624794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624709    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.624794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624743    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.624794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624770    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.624794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624787    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624877    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spg7s\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624939    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.624979    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625014    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625040    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625064    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv47j\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625217    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625241    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625253    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625290    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625309    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625341    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625381    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625775 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625404    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.625775 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625445    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625775 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625444    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.625775 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625520    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.626050 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.625828    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.626160 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.626139    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.627135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.627120    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.627896 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.627860    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.633215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.633190    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.633334 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.633319    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv47j\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j\") pod \"e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") " pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.678323 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.678282    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:37.726900 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.726860    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spg7s\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727093 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.726937    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727093 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.726981    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727093 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727017    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727264 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727215    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727320 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727276    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727320 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727305    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727427 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727325    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727427 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727386    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727433    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.727684 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.727532    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.728031 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.728006    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.728129 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.728096    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.728196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.728179    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.730451 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.730409    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.730743 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.730721    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.736810 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.736541    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spg7s\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.736810 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.736713    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token\") pod \"e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") " pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.836811 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.836759    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:37.974981 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.974203    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:00:37.982163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.982106    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:37.982296 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.982208    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:37.982296 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:37.982255    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:38.115395 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.115367    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:00:38.116303 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:38.116269    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9776badb_60b8_41ed_97bc_5d3fe194b47a.slice/crio-f9ac7a4ad208716d72c6cc21f6896ebd1ee55b02a2feb1e651cfa78f6a6f0dde WatchSource:0}: Error finding container f9ac7a4ad208716d72c6cc21f6896ebd1ee55b02a2feb1e651cfa78f6a6f0dde: Status 404 returned error can't find the container with id f9ac7a4ad208716d72c6cc21f6896ebd1ee55b02a2feb1e651cfa78f6a6f0dde
Sep 11 19:00:38.118735 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.118704    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:38.118817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.118772    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:38.118817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.118797    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:00:38.970096 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.970056    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerStarted","Data":"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"}
Sep 11 19:00:38.970540 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.970135    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerStarted","Data":"3bb6d590dc049f05b73e041911914e32010440ed28910ec0b4a1d409c5a2cd09"}
Sep 11 19:00:38.971829 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.971793    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerStarted","Data":"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"}
Sep 11 19:00:38.971966 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.971853    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerStarted","Data":"f9ac7a4ad208716d72c6cc21f6896ebd1ee55b02a2feb1e651cfa78f6a6f0dde"}
Sep 11 19:00:38.992133 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:38.992068    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podStartSLOduration=1.992044598 podStartE2EDuration="1.992044598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:38.989973091 +0000 UTC m=+717.476896970" watchObservedRunningTime="2026-09-11 19:00:38.992044598 +0000 UTC m=+717.478968483"
Sep 11 19:00:39.009472 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.009418    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podStartSLOduration=2.009397929 podStartE2EDuration="2.009397929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:39.007010984 +0000 UTC m=+717.493934860" watchObservedRunningTime="2026-09-11 19:00:39.009397929 +0000 UTC m=+717.496321857"
Sep 11 19:00:39.678771 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.678730    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:39.684249 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.684217    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:39.837644 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.837608    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:39.844014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.843983    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:39.979329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.979247    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:39.979884 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.979856    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:39.980329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.980305    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:00:39.980449 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:39.980360    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:00:42.140858 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.140824    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:00:42.145828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.145796    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.149961 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.149052    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-c1aebc-serving-cert\""
Sep 11 19:00:42.154646 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.154616    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:00:42.219191 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.219150    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:00:42.275634 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.275517    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p629\" (UniqueName: \"kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.275634 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.275583    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.275885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.275776    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.275885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.275809    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.377522 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.377473    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.377837 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.377812    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.377988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.377971    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p629\" (UniqueName: \"kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.378126 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.378100    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.378699 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:00:42.378677    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-serving-cert: secret "maas-api-e2e-worker-w4-c1aebc-serving-cert" not found
Sep 11 19:00:42.378879 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:00:42.378868    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls podName:bad200e9-38ba-4bba-92c0-a097ea66eab6 nodeName:}" failed. No retries permitted until 2026-09-11 19:00:42.878847479 +0000 UTC m=+721.365771350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls") pod "maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" (UID: "bad200e9-38ba-4bba-92c0-a097ea66eab6") : secret "maas-api-e2e-worker-w4-c1aebc-serving-cert" not found
Sep 11 19:00:42.379264 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.379228    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.381647 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.381625    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.387014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.386984    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p629\" (UniqueName: \"kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.883671 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.883617    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:42.886130 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:42.886105    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:43.061698 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.061657    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:43.349651 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.349617    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:00:43.350920 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:43.350896    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad200e9_38ba_4bba_92c0_a097ea66eab6.slice/crio-9e8bba2c6ffd1c14ac8d516d20080c6f334aa543e166715bfe1d157dca6dac17 WatchSource:0}: Error finding container 9e8bba2c6ffd1c14ac8d516d20080c6f334aa543e166715bfe1d157dca6dac17: Status 404 returned error can't find the container with id 9e8bba2c6ffd1c14ac8d516d20080c6f334aa543e166715bfe1d157dca6dac17
Sep 11 19:00:43.421989 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.421938    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:00:43.428917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.428890    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.432510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.431846    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-62499f-serving-cert\""
Sep 11 19:00:43.441017 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.440986    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:00:43.591684 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.591627    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.591875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.591723    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.591875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.591801    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wwkc\" (UniqueName: \"kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.591875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.591844    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.693424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.693380    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wwkc\" (UniqueName: \"kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.693675 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.693471    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.693675 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.693540    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.693675 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.693669    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.694514 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.694484    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.696411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.696384    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.696709 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.696682    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.702309 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.702281    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wwkc\" (UniqueName: \"kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc\") pod \"maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:43.754237 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:43.754208    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:44.007274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.007174    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" event={"ID":"bad200e9-38ba-4bba-92c0-a097ea66eab6","Type":"ContainerStarted","Data":"c25b3d5a5b696f9c9dab7f87476ab8084d3143f1f3c9bbbbf0ad982515fdef9b"}
Sep 11 19:00:44.007274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.007246    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" event={"ID":"bad200e9-38ba-4bba-92c0-a097ea66eab6","Type":"ContainerStarted","Data":"9e8bba2c6ffd1c14ac8d516d20080c6f334aa543e166715bfe1d157dca6dac17"}
Sep 11 19:00:44.007470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.007378    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:44.028905 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.028842    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" podStartSLOduration=1.648676695 podStartE2EDuration="2.028821206s" totalImagesPullingTime="380.144511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:44.024753805 +0000 UTC m=+722.511677684" watchObservedRunningTime="2026-09-11 19:00:44.028821206 +0000 UTC m=+722.515745085"
Sep 11 19:00:44.048979 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.048949    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:00:44.051496 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:44.051469    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640cefa4_02d5_4e32_87da_56872333063c.slice/crio-37c37615f9a75eb363e022874d6fafc4b524e800cf8a3663581582e4ec8a050d WatchSource:0}: Error finding container 37c37615f9a75eb363e022874d6fafc4b524e800cf8a3663581582e4ec8a050d: Status 404 returned error can't find the container with id 37c37615f9a75eb363e022874d6fafc4b524e800cf8a3663581582e4ec8a050d
Sep 11 19:00:44.531097 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.530581    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:00:44.545964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.545929    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:00:44.546266 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.546247    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.548891 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.548865    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c6c610-serving-cert\""
Sep 11 19:00:44.703824 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.703791    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.704024 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.703851    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.704024 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.703878    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4h6g\" (UniqueName: \"kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.704143 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.704026    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.805230 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.805125    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.805230 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.805170    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4h6g\" (UniqueName: \"kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.805488 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.805271    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.805488 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.805346    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.806296 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.806228    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.807879 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.807845    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.808174 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.808156    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.820071 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.820004    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4h6g\" (UniqueName: \"kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g\") pod \"maas-api-e2e-inf-a-c6c610-86b484c549-942jg\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:44.871235 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:44.871194    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:45.014794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:45.014753    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" event={"ID":"640cefa4-02d5-4e32-87da-56872333063c","Type":"ContainerStarted","Data":"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"}
Sep 11 19:00:45.014997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:45.014822    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" event={"ID":"640cefa4-02d5-4e32-87da-56872333063c","Type":"ContainerStarted","Data":"37c37615f9a75eb363e022874d6fafc4b524e800cf8a3663581582e4ec8a050d"}
Sep 11 19:00:45.014997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:45.014853    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:45.042921 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:45.042863    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" podStartSLOduration=1.604778496 podStartE2EDuration="2.042843885s" totalImagesPullingTime="438.065389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:45.041491853 +0000 UTC m=+723.528415731" watchObservedRunningTime="2026-09-11 19:00:45.042843885 +0000 UTC m=+723.529767764"
Sep 11 19:00:45.157473 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:45.157443    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:00:45.159233 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:45.159209    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc86cc87_2aac_43d6_9739_0f608c2c4975.slice/crio-bc2fc27e2b8efd0db6951cff8a4373f72ff2f2061f4268f6f9259ee7660e1da2 WatchSource:0}: Error finding container bc2fc27e2b8efd0db6951cff8a4373f72ff2f2061f4268f6f9259ee7660e1da2: Status 404 returned error can't find the container with id bc2fc27e2b8efd0db6951cff8a4373f72ff2f2061f4268f6f9259ee7660e1da2
Sep 11 19:00:46.022760 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:46.022723    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" event={"ID":"fc86cc87-2aac-43d6-9739-0f608c2c4975","Type":"ContainerStarted","Data":"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"}
Sep 11 19:00:46.023176 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:46.022782    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" event={"ID":"fc86cc87-2aac-43d6-9739-0f608c2c4975","Type":"ContainerStarted","Data":"bc2fc27e2b8efd0db6951cff8a4373f72ff2f2061f4268f6f9259ee7660e1da2"}
Sep 11 19:00:46.023176 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:46.022808    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:46.042852 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:46.042786    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" podStartSLOduration=1.687354077 podStartE2EDuration="2.042763672s" totalImagesPullingTime="355.409595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:46.039968197 +0000 UTC m=+724.526892077" watchObservedRunningTime="2026-09-11 19:00:46.042763672 +0000 UTC m=+724.529687551"
Sep 11 19:00:50.021918 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:50.021881    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:00:51.029123 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:51.029088    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:00:51.316483 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:51.316389    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:00:52.035589 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:52.035560    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:00:53.394616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.392646    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:00:53.414618 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.414246    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.424970 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.424926    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:00:53.429892 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.429860    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aff2b8e2-serving-cert\""
Sep 11 19:00:53.607848 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.607801    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.608495 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.608467    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.608724 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.608707    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqvw\" (UniqueName: \"kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.608926 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.608912    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.709992 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.709946    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.710824 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.710800    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqvw\" (UniqueName: \"kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.711461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.711437    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.711655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.711637    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.712538 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.712517    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.715617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.715580    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.716234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.716214    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.722624 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.722373    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqvw\" (UniqueName: \"kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw\") pod \"maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:53.767369 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:53.767329    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:54.100024 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.089881    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:00:54.100024 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:00:54.099733    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97781d68_2336_4a8f_89ab_1a0b56284560.slice/crio-575be52dbd42999bce0e0c331f167b14d64eaae07ad4b3a082b4f2c5bc2bdc1a WatchSource:0}: Error finding container 575be52dbd42999bce0e0c331f167b14d64eaae07ad4b3a082b4f2c5bc2bdc1a: Status 404 returned error can't find the container with id 575be52dbd42999bce0e0c331f167b14d64eaae07ad4b3a082b4f2c5bc2bdc1a
Sep 11 19:00:54.830990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.828636    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:00:54.841758 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.837475    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.844640 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.844303    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-89e163-serving-cert\""
Sep 11 19:00:54.845085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.845059    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:00:54.847344 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.847319    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.847466 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.847352    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.847537 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.847492    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.847537 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.847517    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdw5\" (UniqueName: \"kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.948219 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.948188    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.948446 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.948429    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdw5\" (UniqueName: \"kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.948545 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.948534    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.948664 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.948653    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.949023 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:00:54.948684    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-89e163-serving-cert: secret "maas-api-e2e-autores-89e163-serving-cert" not found
Sep 11 19:00:54.949023 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:00:54.948868    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls podName:08bc7bb2-c5d0-4207-b40a-59753fbaa474 nodeName:}" failed. No retries permitted until 2026-09-11 19:00:55.448852364 +0000 UTC m=+733.935776224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls") pod "maas-api-e2e-autores-89e163-754f7697db-9knt9" (UID: "08bc7bb2-c5d0-4207-b40a-59753fbaa474") : secret "maas-api-e2e-autores-89e163-serving-cert" not found
Sep 11 19:00:54.949237 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.949168    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.951642 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.951557    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:54.959858 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:54.959834    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdw5\" (UniqueName: \"kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:55.094859 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.094753    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" event={"ID":"97781d68-2336-4a8f-89ab-1a0b56284560","Type":"ContainerStarted","Data":"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"}
Sep 11 19:00:55.095113 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.095095    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" event={"ID":"97781d68-2336-4a8f-89ab-1a0b56284560","Type":"ContainerStarted","Data":"575be52dbd42999bce0e0c331f167b14d64eaae07ad4b3a082b4f2c5bc2bdc1a"}
Sep 11 19:00:55.096141 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.096116    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:00:55.115543 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.115478    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" podStartSLOduration=1.664640913 podStartE2EDuration="2.115456305s" totalImagesPullingTime="450.815392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:55.113409497 +0000 UTC m=+733.600333377" watchObservedRunningTime="2026-09-11 19:00:55.115456305 +0000 UTC m=+733.602380186"
Sep 11 19:00:55.452827 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.452788    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:55.455414 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.455390    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") pod \"maas-api-e2e-autores-89e163-754f7697db-9knt9\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:55.459277 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.459254    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:55.803384 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:55.803279    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:00:56.107565 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:56.107471    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" event={"ID":"08bc7bb2-c5d0-4207-b40a-59753fbaa474","Type":"ContainerStarted","Data":"b512c28f3f9a9a501c99d159b4f96120758574d7f8a6aced6e184ec6a6eac385"}
Sep 11 19:00:57.120899 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:57.120857    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" event={"ID":"08bc7bb2-c5d0-4207-b40a-59753fbaa474","Type":"ContainerStarted","Data":"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"}
Sep 11 19:00:57.121394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:57.120942    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:00:57.146189 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:00:57.146134    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" podStartSLOduration=2.706120366 podStartE2EDuration="3.14611785s" totalImagesPullingTime="439.997484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:00:57.144895155 +0000 UTC m=+735.631819034" watchObservedRunningTime="2026-09-11 19:00:57.14611785 +0000 UTC m=+735.633041728"
Sep 11 19:01:02.125906 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.125876    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:01:02.159943 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.159910    2587 generic.go:356] "Generic (PLEG): container finished" podID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerID="c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2" exitCode=0
Sep 11 19:01:02.160131 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.159978    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerDied","Data":"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"}
Sep 11 19:01:02.160557 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.160520    2587 scope.go:117] "RemoveContainer" containerID="c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"
Sep 11 19:01:02.162269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.162226    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.162396 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.162332    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.162396 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.162382    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.162659 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.162637    2587 generic.go:356] "Generic (PLEG): container finished" podID="13129668-6195-4d46-86ae-dae26bfb8373" containerID="9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341" exitCode=0
Sep 11 19:01:02.162754 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.162718    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerDied","Data":"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"}
Sep 11 19:01:02.163197 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.163178    2587 scope.go:117] "RemoveContainer" containerID="9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"
Sep 11 19:01:02.170473 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.168182    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.170473 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.168338    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.170473 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.168424    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:02.860935 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.860895    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:01:02.864533 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.864493    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:02.866801 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.866769    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-093f6c-serving-cert\""
Sep 11 19:01:02.884312 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.884277    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:01:02.945572 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.945534    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:02.945767 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.945677    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:02.945767 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.945713    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kn6\" (UniqueName: \"kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:02.945767 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:02.945762    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.046478 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.046435    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.046704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.046530    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.046704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.046550    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kn6\" (UniqueName: \"kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.046704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.046588    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.047444 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.047413    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.049229 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.049203    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.049738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.049708    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.058562 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.058486    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kn6\" (UniqueName: \"kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6\") pod \"maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.172477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.172382    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerStarted","Data":"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"}
Sep 11 19:01:03.175329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.175290    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerStarted","Data":"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"}
Sep 11 19:01:03.182334 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.182296    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:03.513806 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.512877    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:01:03.530922 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:01:03.530884    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0419bc_1994_4f84_8e2b_e40d00433205.slice/crio-fad4de33169556172c0e3fd55a4dbe81e8e5d6f4c479bc22762dccc98fd707c3 WatchSource:0}: Error finding container fad4de33169556172c0e3fd55a4dbe81e8e5d6f4c479bc22762dccc98fd707c3: Status 404 returned error can't find the container with id fad4de33169556172c0e3fd55a4dbe81e8e5d6f4c479bc22762dccc98fd707c3
Sep 11 19:01:03.686620 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.681156    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:03.686620 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.681258    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:03.686620 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.681651    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:01:03.837895 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.837788    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:01:03.838097 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.838070    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:03.838151 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:03.838127    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:04.143239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.143143    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:01:04.191575 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.191543    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" event={"ID":"2d0419bc-1994-4f84-8e2b-e40d00433205","Type":"ContainerStarted","Data":"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"}
Sep 11 19:01:04.192156 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.192119    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" event={"ID":"2d0419bc-1994-4f84-8e2b-e40d00433205","Type":"ContainerStarted","Data":"fad4de33169556172c0e3fd55a4dbe81e8e5d6f4c479bc22762dccc98fd707c3"}
Sep 11 19:01:04.192739 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.192657    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:04.211628 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.211283    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" podStartSLOduration=1.875705113 podStartE2EDuration="2.211256751s" totalImagesPullingTime="335.551638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:01:04.208067911 +0000 UTC m=+742.694991791" watchObservedRunningTime="2026-09-11 19:01:04.211256751 +0000 UTC m=+742.698180633"
Sep 11 19:01:04.679535 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.679487    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:04.679779 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.679567    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:04.837468 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.837413    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:04.837688 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:04.837494    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:05.679654 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:05.679609    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:05.680191 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:05.679683    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:05.837219 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:05.837182    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:05.837383 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:05.837240    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:06.679448 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:06.679408    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:06.679746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:06.679714    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:06.838006 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:06.837969    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:06.838194 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:06.838034    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:07.678819 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:07.678776    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:07.679033 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:07.678862    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:07.837146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:07.837105    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:07.837561 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:07.837172    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:08.679034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:08.678988    2587 patch_prober.go:28] interesting pod/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 19:01:08.679368 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:08.679320    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 19:01:08.838215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:08.838170    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 11 19:01:08.838616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:08.838250    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 11 19:01:09.682922 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.682891    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:01:09.683195 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.683171    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:01:09.683886 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.683870    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:01:09.841195 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.841164    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:01:09.841549 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.841455    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:01:09.842335 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:09.842318    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:01:11.218791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:11.218759    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:01:12.311917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:12.311879    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:01:31.214482 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:31.214441    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:01:32.062179 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.062138    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:01:32.062416 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.062389    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" containerName="maas-api" containerID="cri-o://bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b" gracePeriod=30
Sep 11 19:01:32.121306 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.121265    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.62:8443/health\": dial tcp 10.133.0.62:8443: connect: connection refused"
Sep 11 19:01:32.332897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.332872    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:01:32.381711 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.381678    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls\") pod \"97781d68-2336-4a8f-89ab-1a0b56284560\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") "
Sep 11 19:01:32.381877 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.381814    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca\") pod \"97781d68-2336-4a8f-89ab-1a0b56284560\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") "
Sep 11 19:01:32.381942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.381880    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs\") pod \"97781d68-2336-4a8f-89ab-1a0b56284560\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") "
Sep 11 19:01:32.381942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.381923    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkqvw\" (UniqueName: \"kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw\") pod \"97781d68-2336-4a8f-89ab-1a0b56284560\" (UID: \"97781d68-2336-4a8f-89ab-1a0b56284560\") "
Sep 11 19:01:32.382299 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.382262    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97781d68-2336-4a8f-89ab-1a0b56284560" (UID: "97781d68-2336-4a8f-89ab-1a0b56284560"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:01:32.384616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.384567    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97781d68-2336-4a8f-89ab-1a0b56284560" (UID: "97781d68-2336-4a8f-89ab-1a0b56284560"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:01:32.384721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.384696    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97781d68-2336-4a8f-89ab-1a0b56284560" (UID: "97781d68-2336-4a8f-89ab-1a0b56284560"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:01:32.384768 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.384716    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw" (OuterVolumeSpecName: "kube-api-access-rkqvw") pod "97781d68-2336-4a8f-89ab-1a0b56284560" (UID: "97781d68-2336-4a8f-89ab-1a0b56284560"). InnerVolumeSpecName "kube-api-access-rkqvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:01:32.391824 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.391791    2587 generic.go:356] "Generic (PLEG): container finished" podID="97781d68-2336-4a8f-89ab-1a0b56284560" containerID="bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b" exitCode=0
Sep 11 19:01:32.391973 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.391856    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"
Sep 11 19:01:32.391973 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.391944    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" event={"ID":"97781d68-2336-4a8f-89ab-1a0b56284560","Type":"ContainerDied","Data":"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"}
Sep 11 19:01:32.392095 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.391995    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr" event={"ID":"97781d68-2336-4a8f-89ab-1a0b56284560","Type":"ContainerDied","Data":"575be52dbd42999bce0e0c331f167b14d64eaae07ad4b3a082b4f2c5bc2bdc1a"}
Sep 11 19:01:32.392095 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.392027    2587 scope.go:117] "RemoveContainer" containerID="bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"
Sep 11 19:01:32.409786 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.409761    2587 scope.go:117] "RemoveContainer" containerID="bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"
Sep 11 19:01:32.410103 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:01:32.410079    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b\": container with ID starting with bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b not found: ID does not exist" containerID="bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"
Sep 11 19:01:32.410197 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.410111    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b"} err="failed to get container status \"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b\": rpc error: code = NotFound desc = could not find container \"bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b\": container with ID starting with bbe473574b94ef3e7437709d8658e24aa704b2da921d22c10fa38c987a0c451b not found: ID does not exist"
Sep 11 19:01:32.431204 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.431173    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:01:32.433871 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.433850    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aff2b8e2-5785c465d7-qxvqr"]
Sep 11 19:01:32.483430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.483399    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:01:32.483430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.483424    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkqvw\" (UniqueName: \"kubernetes.io/projected/97781d68-2336-4a8f-89ab-1a0b56284560-kube-api-access-rkqvw\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:01:32.483430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.483436    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97781d68-2336-4a8f-89ab-1a0b56284560-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:01:32.483786 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:32.483447    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97781d68-2336-4a8f-89ab-1a0b56284560-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:01:33.453466 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.453420    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:01:33.454232 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.454204    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" containerName="maas-api"
Sep 11 19:01:33.454232 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.454226    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" containerName="maas-api"
Sep 11 19:01:33.454403 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.454390    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" containerName="maas-api"
Sep 11 19:01:33.457331 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.457310    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.459548 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.459527    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c158570a-gw-openshift-default-dockercfg-b27pj\""
Sep 11 19:01:33.469302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.469275    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:01:33.494090 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494057    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494105    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494212    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494247    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn92w\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494372 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494286    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494372 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494316    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494372 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494362    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494396    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.494485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.494431    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595433    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595475    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn92w\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595515    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595552    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595586    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595642    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595684    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.595746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595732    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.595782    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.596115    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596260 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.596209    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596323 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.596223    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.596379    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.596454 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.596408    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.598047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.598026    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.598251 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.598233    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.604808 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.604783    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.604897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.604870    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn92w\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w\") pod \"e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") " pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.771073 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.770985    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:33.996397 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:33.996359    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97781d68-2336-4a8f-89ab-1a0b56284560" path="/var/lib/kubelet/pods/97781d68-2336-4a8f-89ab-1a0b56284560/volumes"
Sep 11 19:01:34.051327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.051294    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:01:34.053095 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:01:34.053067    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01950066_61a1_4731_b6ce_bee74a95ee1a.slice/crio-5b67408bc0ceed4d2c08c6f1bda5f5f88ccbeafdeef430b17cdfd915cc245972 WatchSource:0}: Error finding container 5b67408bc0ceed4d2c08c6f1bda5f5f88ccbeafdeef430b17cdfd915cc245972: Status 404 returned error can't find the container with id 5b67408bc0ceed4d2c08c6f1bda5f5f88ccbeafdeef430b17cdfd915cc245972
Sep 11 19:01:34.055651 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.055588    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:34.055739 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.055689    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:34.055739 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.055719    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:34.407641 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.407536    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerStarted","Data":"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"}
Sep 11 19:01:34.407641 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.407614    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerStarted","Data":"5b67408bc0ceed4d2c08c6f1bda5f5f88ccbeafdeef430b17cdfd915cc245972"}
Sep 11 19:01:34.425547 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.425487    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podStartSLOduration=1.42547033 podStartE2EDuration="1.42547033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:01:34.425350457 +0000 UTC m=+772.912274336" watchObservedRunningTime="2026-09-11 19:01:34.42547033 +0000 UTC m=+772.912394207"
Sep 11 19:01:34.772038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:34.771999    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:35.778271 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:35.778238    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:36.420219 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:36.420176    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:36.421298 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:36.421278    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:52.317225 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:52.317184    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:01:52.461836 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:52.461780    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:01:52.462015 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:52.461864    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:01:53.542985 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.542952    2587 generic.go:356] "Generic (PLEG): container finished" podID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerID="fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1" exitCode=0
Sep 11 19:01:53.543453 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.543024    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerDied","Data":"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"}
Sep 11 19:01:53.543530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.543515    2587 scope.go:117] "RemoveContainer" containerID="fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"
Sep 11 19:01:53.544856 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.544824    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:53.544987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.544911    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:53.544987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:53.544965    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:01:54.551306 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:54.551269    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerStarted","Data":"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"}
Sep 11 19:01:54.771788 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:54.771740    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:01:54.772037 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:54.772016    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:54.772089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:54.772074    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:01:55.772352 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:55.772312    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:55.772850 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:55.772379    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:01:56.772405 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:56.772364    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:56.772907 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:56.772429    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:01:57.771988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:57.771948    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:57.772152 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:57.772006    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:01:58.772078 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:58.772041    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:58.772569 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:58.772521    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:01:59.771845 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:59.771806    2587 patch_prober.go:28] interesting pod/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 19:01:59.772038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:01:59.771866    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 19:02:00.776558 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:00.776518    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:02:00.776972 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:00.776951    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:02:00.777698 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:00.777669    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:02:18.125516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:18.125477    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:02:18.126162 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:18.125723    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy" containerID="cri-o://bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e" gracePeriod=30
Sep 11 19:02:23.385659 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.385585    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:02:23.425018 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.424974    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425018 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425030    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn92w\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425097    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425117    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425206    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425241    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425269    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425294    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425326    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data\") pod \"01950066-61a1-4731-b6ce-bee74a95ee1a\" (UID: \"01950066-61a1-4731-b6ce-bee74a95ee1a\") "
Sep 11 19:02:23.425479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425455    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:02:23.425720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425675    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:02:23.425840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425805    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:02:23.425913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425891    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.425969 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425912    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.425969 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425890    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:02:23.426078 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.425995    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:02:23.427537 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.427503    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:02:23.427688 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.427550    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:02:23.427794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.427771    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:02:23.427858 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.427806    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w" (OuterVolumeSpecName: "kube-api-access-kn92w") pod "01950066-61a1-4731-b6ce-bee74a95ee1a" (UID: "01950066-61a1-4731-b6ce-bee74a95ee1a"). InnerVolumeSpecName "kube-api-access-kn92w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:02:23.527447 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527397    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527447 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527438    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527447 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527451    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527463    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01950066-61a1-4731-b6ce-bee74a95ee1a-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527483    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01950066-61a1-4731-b6ce-bee74a95ee1a-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527496    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01950066-61a1-4731-b6ce-bee74a95ee1a-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.527777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.527509    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn92w\" (UniqueName: \"kubernetes.io/projected/01950066-61a1-4731-b6ce-bee74a95ee1a-kube-api-access-kn92w\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:02:23.734590 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.734550    2587 generic.go:356] "Generic (PLEG): container finished" podID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerID="bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e" exitCode=0
Sep 11 19:02:23.734817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.734638    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"
Sep 11 19:02:23.734817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.734651    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerDied","Data":"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"}
Sep 11 19:02:23.734817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.734703    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm" event={"ID":"01950066-61a1-4731-b6ce-bee74a95ee1a","Type":"ContainerDied","Data":"5b67408bc0ceed4d2c08c6f1bda5f5f88ccbeafdeef430b17cdfd915cc245972"}
Sep 11 19:02:23.734817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.734727    2587 scope.go:117] "RemoveContainer" containerID="bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"
Sep 11 19:02:23.748219 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.748199    2587 scope.go:117] "RemoveContainer" containerID="fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"
Sep 11 19:02:23.758252 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.758224    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:02:23.758524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.758439    2587 scope.go:117] "RemoveContainer" containerID="bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"
Sep 11 19:02:23.759061 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:02:23.759001    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e\": container with ID starting with bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e not found: ID does not exist" containerID="bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"
Sep 11 19:02:23.759180 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.759089    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e"} err="failed to get container status \"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e\": rpc error: code = NotFound desc = could not find container \"bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e\": container with ID starting with bfb0e3a4ae8c00186bf32fffceff92cd0fdc8a7685cc861bf319743532c1458e not found: ID does not exist"
Sep 11 19:02:23.759180 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.759119    2587 scope.go:117] "RemoveContainer" containerID="fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"
Sep 11 19:02:23.759515 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:02:23.759495    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1\": container with ID starting with fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1 not found: ID does not exist" containerID="fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"
Sep 11 19:02:23.759585 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.759519    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1"} err="failed to get container status \"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1\": rpc error: code = NotFound desc = could not find container \"fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1\": container with ID starting with fdc6d100f79e2ff867f2ae92b2911a06aec7fe08c0063d056e9ad4e560b56cb1 not found: ID does not exist"
Sep 11 19:02:23.761826 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.761804    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c158570a-gw-openshift-default-6f4b967d4-kjwnm"]
Sep 11 19:02:23.998307 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:23.998225    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" path="/var/lib/kubelet/pods/01950066-61a1-4731-b6ce-bee74a95ee1a/volumes"
Sep 11 19:02:24.812292 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:24.812246    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:02:44.611650 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:44.611609    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:02:54.707149 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.707084    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:02:54.707845 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.707822    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:02:54.707912 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.707849    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:02:54.707912 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.707882    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:02:54.707912 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.707891    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:02:54.708021 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.708002    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:02:54.711774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.711755    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.713863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.713840    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8092ee69-openshift-default-dockercfg-tdrdc\""
Sep 11 19:02:54.723992 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.723966    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:02:54.748246 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748212    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748291    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748328    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748380    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748416    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748643 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748505    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748643 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748560    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748643 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748629    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xxz\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.748795 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.748664    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849429 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849391    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849445    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849467    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849495    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849520    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849548    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849568    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.849621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849608    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xxz\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850019 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849636    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850019 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.849806    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.850097    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.850149    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850243 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.850196    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.850373 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.850356    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.851878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.851857    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.852007 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.851988    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.861694 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.861666    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:54.861802 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:54.861716    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xxz\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz\") pod \"e2e-derive-8092ee69-openshift-default-db77946fb-p49d7\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") " pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:55.022851 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.022761    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:55.304464 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.304436    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:02:55.306175 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:02:55.306144    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecc62b3_4e60_4d4e_a95b_ff032ef5ad83.slice/crio-29136c2ca159a2ee0ad35efd6c751971b733bb01501051ab82bda428cb769dd3 WatchSource:0}: Error finding container 29136c2ca159a2ee0ad35efd6c751971b733bb01501051ab82bda428cb769dd3: Status 404 returned error can't find the container with id 29136c2ca159a2ee0ad35efd6c751971b733bb01501051ab82bda428cb769dd3
Sep 11 19:02:55.308264 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.308232    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:02:55.308343 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.308305    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:02:55.308343 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.308339    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:02:55.940263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.940219    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerStarted","Data":"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"}
Sep 11 19:02:55.940734 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.940346    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerStarted","Data":"29136c2ca159a2ee0ad35efd6c751971b733bb01501051ab82bda428cb769dd3"}
Sep 11 19:02:55.961777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:55.961725    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podStartSLOduration=1.9617096539999999 podStartE2EDuration="1.961709654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:02:55.95955238 +0000 UTC m=+854.446476258" watchObservedRunningTime="2026-09-11 19:02:55.961709654 +0000 UTC m=+854.448633533"
Sep 11 19:02:56.023220 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:56.023173    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:56.028769 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:56.028737    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:56.947191 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:56.947155    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:02:56.948177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:02:56.948157    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:07.535575 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.535540    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:03:07.536056 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.535779    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" podUID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" containerName="maas-api" containerID="cri-o://7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a" gracePeriod=30
Sep 11 19:03:07.802394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.802329    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:03:07.883981 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.883948    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") pod \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") "
Sep 11 19:03:07.884150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.884000    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca\") pod \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") "
Sep 11 19:03:07.884150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.884068    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs\") pod \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") "
Sep 11 19:03:07.884150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.884121    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbdw5\" (UniqueName: \"kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5\") pod \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\" (UID: \"08bc7bb2-c5d0-4207-b40a-59753fbaa474\") "
Sep 11 19:03:07.884502 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.884471    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "08bc7bb2-c5d0-4207-b40a-59753fbaa474" (UID: "08bc7bb2-c5d0-4207-b40a-59753fbaa474"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:03:07.886358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.886333    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "08bc7bb2-c5d0-4207-b40a-59753fbaa474" (UID: "08bc7bb2-c5d0-4207-b40a-59753fbaa474"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:03:07.886480 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.886369    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5" (OuterVolumeSpecName: "kube-api-access-jbdw5") pod "08bc7bb2-c5d0-4207-b40a-59753fbaa474" (UID: "08bc7bb2-c5d0-4207-b40a-59753fbaa474"). InnerVolumeSpecName "kube-api-access-jbdw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:03:07.886633 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.886584    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "08bc7bb2-c5d0-4207-b40a-59753fbaa474" (UID: "08bc7bb2-c5d0-4207-b40a-59753fbaa474"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:03:07.985441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.985396    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:07.985441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.985434    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08bc7bb2-c5d0-4207-b40a-59753fbaa474-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:07.985441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.985445    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08bc7bb2-c5d0-4207-b40a-59753fbaa474-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:07.985712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:07.985454    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbdw5\" (UniqueName: \"kubernetes.io/projected/08bc7bb2-c5d0-4207-b40a-59753fbaa474-kube-api-access-jbdw5\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:08.018530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.018494    2587 generic.go:356] "Generic (PLEG): container finished" podID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" containerID="7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a" exitCode=0
Sep 11 19:03:08.018703 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.018546    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"
Sep 11 19:03:08.018703 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.018578    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" event={"ID":"08bc7bb2-c5d0-4207-b40a-59753fbaa474","Type":"ContainerDied","Data":"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"}
Sep 11 19:03:08.018703 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.018651    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9" event={"ID":"08bc7bb2-c5d0-4207-b40a-59753fbaa474","Type":"ContainerDied","Data":"b512c28f3f9a9a501c99d159b4f96120758574d7f8a6aced6e184ec6a6eac385"}
Sep 11 19:03:08.018703 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.018680    2587 scope.go:117] "RemoveContainer" containerID="7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"
Sep 11 19:03:08.028491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.028468    2587 scope.go:117] "RemoveContainer" containerID="7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"
Sep 11 19:03:08.028816 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:03:08.028790    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a\": container with ID starting with 7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a not found: ID does not exist" containerID="7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"
Sep 11 19:03:08.028904 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.028824    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a"} err="failed to get container status \"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a\": rpc error: code = NotFound desc = could not find container \"7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a\": container with ID starting with 7e0a6f973ad160f66b52e29f7310cf3e458256fd6a28f2606189cad106a7b55a not found: ID does not exist"
Sep 11 19:03:08.035255 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.035231    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:03:08.040211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:08.040174    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-89e163-754f7697db-9knt9"]
Sep 11 19:03:09.998027 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:09.997995    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" path="/var/lib/kubelet/pods/08bc7bb2-c5d0-4207-b40a-59753fbaa474/volumes"
Sep 11 19:03:12.009876 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:12.009842    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:03:23.136370 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.136333    2587 generic.go:356] "Generic (PLEG): container finished" podID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerID="afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5" exitCode=0
Sep 11 19:03:23.136815 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.136407    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerDied","Data":"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"}
Sep 11 19:03:23.136885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.136869    2587 scope.go:117] "RemoveContainer" containerID="afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"
Sep 11 19:03:23.138019 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.137988    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:23.138080 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.138065    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:23.138119 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:23.138094    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:24.152089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:24.152050    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerStarted","Data":"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"}
Sep 11 19:03:25.022966 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:25.022932    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:25.024158 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:25.024132    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:03:25.024285 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:25.024192    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 11 19:03:26.023220 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:26.023184    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:03:26.023875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:26.023249    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 11 19:03:26.947263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:26.947231    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:27.024162 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:27.024126    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:03:27.024523 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:27.024181    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 11 19:03:28.023313 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:28.023270    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:03:28.023528 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:28.023346    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 11 19:03:29.023891 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:29.023847    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:03:29.024288 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:29.023917    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 11 19:03:30.027478 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:30.027444    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:30.028444 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:30.028421    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:39.844438 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:39.844343    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:03:40.314804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:40.314770    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:03:40.315044 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:40.314997    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" containerID="cri-o://04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5" gracePeriod=30
Sep 11 19:03:45.030941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.030896    2587 patch_prober.go:28] interesting pod/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 19:03:45.031334 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.030967    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:03:45.567473 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.567448    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:45.702277 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702239    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702493 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702315    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702493 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702387    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702493 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702440    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94xxz\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702584    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:03:45.702712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702621    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702680    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702706    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702932 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702730    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.702932 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702777    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs\") pod \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\" (UID: \"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83\") "
Sep 11 19:03:45.703028 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702961    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:03:45.703028 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.702973    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:03:45.703173 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703150    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:03:45.703301 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703248    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:03:45.703389 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703317    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.703389 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703332    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.703389 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703340    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.703389 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.703349    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.704782 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.704758    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:03:45.704939 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.704916    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:03:45.705120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.705103    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:03:45.705120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.705111    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz" (OuterVolumeSpecName: "kube-api-access-94xxz") pod "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" (UID: "6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83"). InnerVolumeSpecName "kube-api-access-94xxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:03:45.804732 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.804690    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.804732 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.804729    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.804937 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.804743    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94xxz\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-kube-api-access-94xxz\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.804937 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.804756    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:45.804937 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:45.804765    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:03:46.294563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.294464    2587 generic.go:356] "Generic (PLEG): container finished" podID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerID="04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5" exitCode=0
Sep 11 19:03:46.294563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.294509    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"
Sep 11 19:03:46.294563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.294506    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerDied","Data":"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"}
Sep 11 19:03:46.295107 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.294572    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7" event={"ID":"6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83","Type":"ContainerDied","Data":"29136c2ca159a2ee0ad35efd6c751971b733bb01501051ab82bda428cb769dd3"}
Sep 11 19:03:46.295107 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.294618    2587 scope.go:117] "RemoveContainer" containerID="04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"
Sep 11 19:03:46.304290 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.304268    2587 scope.go:117] "RemoveContainer" containerID="afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"
Sep 11 19:03:46.312658 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.312615    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:03:46.313290 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.313274    2587 scope.go:117] "RemoveContainer" containerID="04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"
Sep 11 19:03:46.313579 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:03:46.313556    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5\": container with ID starting with 04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5 not found: ID does not exist" containerID="04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"
Sep 11 19:03:46.313698 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.313604    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5"} err="failed to get container status \"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5\": rpc error: code = NotFound desc = could not find container \"04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5\": container with ID starting with 04c7738c09f2e6d3ec77d26115938ff685b862f4fc8ac13fca5f93d8dab03fd5 not found: ID does not exist"
Sep 11 19:03:46.313698 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.313630    2587 scope.go:117] "RemoveContainer" containerID="afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"
Sep 11 19:03:46.313988 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:03:46.313961    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5\": container with ID starting with afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5 not found: ID does not exist" containerID="afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"
Sep 11 19:03:46.314118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.313995    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5"} err="failed to get container status \"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5\": rpc error: code = NotFound desc = could not find container \"afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5\": container with ID starting with afbe10fddf3ecdac8f10c9971a2cd0fa0e4b406e42fecda5276d4c3e29079be5 not found: ID does not exist"
Sep 11 19:03:46.316979 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:46.316960    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8092ee69-openshift-default-db77946fb-p49d7"]
Sep 11 19:03:47.996028 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:47.995987    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" path="/var/lib/kubelet/pods/6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83/volumes"
Sep 11 19:03:51.062533 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.062500    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:03:51.063170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063149    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.063272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063173    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.063272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063195    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.063272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063203    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.063272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063220    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" containerName="maas-api"
Sep 11 19:03:51.063272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063266    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" containerName="maas-api"
Sep 11 19:03:51.063524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063402    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="01950066-61a1-4731-b6ce-bee74a95ee1a" containerName="istio-proxy"
Sep 11 19:03:51.063524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063418    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="08bc7bb2-c5d0-4207-b40a-59753fbaa474" containerName="maas-api"
Sep 11 19:03:51.063524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063428    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.063524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.063439    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ecc62b3-4e60-4d4e-a95b-ff032ef5ad83" containerName="istio-proxy"
Sep 11 19:03:51.068355 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.068332    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.070499 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.070480    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f60615-openshift-default-dockercfg-dcmdx\""
Sep 11 19:03:51.081255 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.081229    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:03:51.261832 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.261794    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.261855    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.261939    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.261981    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.262010    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.262028    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262251 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.262099    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbzh\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262251 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.262119    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.262251 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.262134    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363017    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363057    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363076    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363112    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbzh\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363129    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363144    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363214    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363278    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363391 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363335    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363750 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363539    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363830 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363805    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363902 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363835    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.363902 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.363877    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.364116 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.364092    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.365512 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.365492    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.365568 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.365555    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.371041 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.371019    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.371246 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.371224    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbzh\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh\") pod \"e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") " pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.379728 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.379700    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:51.656875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.656847    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:03:51.657950 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:03:51.657923    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3674048f_97b7_47e3_8f8a_29d340159d26.slice/crio-250d18a2a0a5f8d8131d06d42f4f6208922a7e51c5a1e32d816da5ffeaa06a6d WatchSource:0}: Error finding container 250d18a2a0a5f8d8131d06d42f4f6208922a7e51c5a1e32d816da5ffeaa06a6d: Status 404 returned error can't find the container with id 250d18a2a0a5f8d8131d06d42f4f6208922a7e51c5a1e32d816da5ffeaa06a6d
Sep 11 19:03:51.660247 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.660214    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:51.660352 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.660293    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:51.660352 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:51.660337    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:03:52.335762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:52.335715    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerStarted","Data":"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"}
Sep 11 19:03:52.336240 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:52.335780    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerStarted","Data":"250d18a2a0a5f8d8131d06d42f4f6208922a7e51c5a1e32d816da5ffeaa06a6d"}
Sep 11 19:03:52.356428 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:52.356371    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podStartSLOduration=1.3563536840000001 podStartE2EDuration="1.356353684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:03:52.353927873 +0000 UTC m=+910.840851766" watchObservedRunningTime="2026-09-11 19:03:52.356353684 +0000 UTC m=+910.843277562"
Sep 11 19:03:52.380312 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:52.380284    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:52.385850 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:52.385828    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:53.342164 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:53.342130    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:03:53.343066 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:03:53.343046    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:04:01.112720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:01.112680    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:04:22.118470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:22.118432    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:04:24.144991 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.144183    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:44762->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Sep 11 19:04:24.144991 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.144263    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:44762->10.133.0.67:15021: read: connection reset by peer"
Sep 11 19:04:24.548150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.548112    2587 generic.go:356] "Generic (PLEG): container finished" podID="3674048f-97b7-47e3-8f8a-29d340159d26" containerID="c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd" exitCode=0
Sep 11 19:04:24.548374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.548189    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerDied","Data":"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"}
Sep 11 19:04:24.548707 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.548683    2587 scope.go:117] "RemoveContainer" containerID="c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"
Sep 11 19:04:24.550358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.550315    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:04:24.550503 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.550420    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:04:24.550503 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:24.550482    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:04:25.555791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:25.555754    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerStarted","Data":"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"}
Sep 11 19:04:26.380529 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:26.380484    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:04:26.380921 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:26.380889    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:04:26.381032 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:26.380951    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 19:04:27.380455 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:27.380414    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:04:27.380988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:27.380484    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 19:04:28.380210 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:28.380158    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:04:28.380439 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:28.380235    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 19:04:29.381030 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:29.380989    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:04:29.382094 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:29.381640    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 19:04:30.380363 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:30.380313    2587 patch_prober.go:28] interesting pod/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 11 19:04:30.380582 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:30.380385    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 11 19:04:31.384678 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:31.384645    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:04:31.385085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:31.385000    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:04:31.385823 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:31.385802    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:04:39.110115 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:04:39.110077    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:05:04.211626 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:04.211500    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:05:16.119274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.119228    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:05:16.122262 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.122245    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.124838 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.124814    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9a60dde0-openshift-default-dockercfg-rpd2s\""
Sep 11 19:05:16.139648 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.139588    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:05:16.150547 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150507    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150728 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150553    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150728 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150582    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150846 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150717    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150846 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150828    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150889    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql5s\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.150997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.150939    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.151083 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.151006    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.151147 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.151089    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.251988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.251952    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql5s\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.251996    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252019    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252062    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252089    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252113    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252139    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252203    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252272    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252431    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252492    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252708 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252560    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252708 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252663    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.252908 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.252891    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.254492 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.254469    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.254715 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.254697    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.259779 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.259751    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.259883 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.259862    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql5s\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s\") pod \"e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") " pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.433162 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.433125    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:16.714988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.714956    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:05:16.715435 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:05:16.715411    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fd6230_6322_4f52_9be8_f344e5007055.slice/crio-33eb84e7bfb12c55247fe42c4dab97e063d6ba96485ca93fb17eb90dbb293994 WatchSource:0}: Error finding container 33eb84e7bfb12c55247fe42c4dab97e063d6ba96485ca93fb17eb90dbb293994: Status 404 returned error can't find the container with id 33eb84e7bfb12c55247fe42c4dab97e063d6ba96485ca93fb17eb90dbb293994
Sep 11 19:05:16.717792 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.717760    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:16.717889 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.717824    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:16.717889 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.717852    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:16.881857 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.881811    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerStarted","Data":"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"}
Sep 11 19:05:16.882051 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.881871    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerStarted","Data":"33eb84e7bfb12c55247fe42c4dab97e063d6ba96485ca93fb17eb90dbb293994"}
Sep 11 19:05:16.928666 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:16.928585    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podStartSLOduration=0.928566152 podStartE2EDuration="928.566152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:05:16.927731578 +0000 UTC m=+995.414655458" watchObservedRunningTime="2026-09-11 19:05:16.928566152 +0000 UTC m=+995.415490031"
Sep 11 19:05:17.433311 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:17.433271    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:17.439551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:17.439522    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:17.888143 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:17.888054    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:17.889181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:17.889161    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:34.906148 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:34.906099    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:05:46.089728 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.089688    2587 generic.go:356] "Generic (PLEG): container finished" podID="d0fd6230-6322-4f52-9be8-f344e5007055" containerID="3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a" exitCode=0
Sep 11 19:05:46.090159 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.089762    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerDied","Data":"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"}
Sep 11 19:05:46.090220 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.090204    2587 scope.go:117] "RemoveContainer" containerID="3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"
Sep 11 19:05:46.091373 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.091340    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:46.091477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.091426    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:46.091540 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:46.091477    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:05:47.102946 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:47.102907    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerStarted","Data":"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"}
Sep 11 19:05:47.433863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:47.433825    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:47.435202 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:47.435172    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:47.435352 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:47.435248    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:47.889105 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:47.888994    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:48.434194 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:48.434151    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:48.434723 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:48.434237    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:49.434153 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:49.434118    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:49.434333 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:49.434189    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:50.434341 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:50.434295    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:50.434790 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:50.434380    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:51.433656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:51.433622    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:51.433861 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:51.433687    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:52.433795 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:52.433757    2587 patch_prober.go:28] interesting pod/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:05:52.434181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:52.433814    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 19:05:53.438849 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:53.438817    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:53.440083 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:53.440059    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:05:55.236029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.235985    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:05:55.239125 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.239099    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.242116 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.242093    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-62499f\"/\"openshift-service-ca.crt\""
Sep 11 19:05:55.242315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.242123    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-62499f\"/\"distinct-w0-62499f-kserve-self-signed-certs\""
Sep 11 19:05:55.242478 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.242127    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-62499f\"/\"kube-root-ca.crt\""
Sep 11 19:05:55.242640 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.242243    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-62499f\"/\"default-dockercfg-mg452\""
Sep 11 19:05:55.249486 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.249461    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:05:55.281745 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281709    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.281913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281753    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.281913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281786    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.281913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281852    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.282047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281908    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrrf\" (UniqueName: \"kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.282047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.281982    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383403 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383360    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383413    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383453    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383519    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383556    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrrf\" (UniqueName: \"kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383868 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383655    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383868 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383843    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383994 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383958    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.383994 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.383967    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.385999 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.385975    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.386095 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.386010    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.391779 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.391752    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrrf\" (UniqueName: \"kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf\") pod \"distinct-w0-62499f-kserve-76d6694fcf-4sq4t\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") " pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.551295 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.551202    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:05:55.828332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:55.828301    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:05:55.830003 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:05:55.829974    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda54d2f34_26ed_4541_ac0c_8895e50627f6.slice/crio-91202f91b9cbb2bdbfc1b2b9e13ce8660d19b5018cf13cc5dbeb5598bde8045e WatchSource:0}: Error finding container 91202f91b9cbb2bdbfc1b2b9e13ce8660d19b5018cf13cc5dbeb5598bde8045e: Status 404 returned error can't find the container with id 91202f91b9cbb2bdbfc1b2b9e13ce8660d19b5018cf13cc5dbeb5598bde8045e
Sep 11 19:05:56.161059 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:56.160966    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" event={"ID":"a54d2f34-26ed-4541-ac0c-8895e50627f6","Type":"ContainerStarted","Data":"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"}
Sep 11 19:05:56.161059 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:56.161008    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" event={"ID":"a54d2f34-26ed-4541-ac0c-8895e50627f6","Type":"ContainerStarted","Data":"91202f91b9cbb2bdbfc1b2b9e13ce8660d19b5018cf13cc5dbeb5598bde8045e"}
Sep 11 19:05:56.182300 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:05:56.182241    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" podStartSLOduration=1.182222744 podStartE2EDuration="1.182222744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:05:56.179262975 +0000 UTC m=+1034.666186857" watchObservedRunningTime="2026-09-11 19:05:56.182222744 +0000 UTC m=+1034.669146622"
Sep 11 19:06:05.552269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:05.552220    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:06:05.552269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:05.552280    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:06:05.565411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:05.565379    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:06:06.235852 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:06.235819    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:06:08.545793 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:08.545758    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:06:08.546612 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:08.546561    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy" containerID="cri-o://a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf" gracePeriod=30
Sep 11 19:06:09.264498 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.264463    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:06:09.267267 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.267235    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.269869 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.269843    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f70e4e-openshift-default-dockercfg-vtzw4\""
Sep 11 19:06:09.281836 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.281808    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:06:09.432178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432131    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432196    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432292    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432337    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432366    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg294\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432397    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432430    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432452    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.432737 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.432550    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533695 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533573    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533695 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533672    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533721    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533759    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533782    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg294\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533811    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.533917 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.533846    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534039    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534086    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534092    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534117    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534392 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534352    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534415    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.534847 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.534823    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.536114 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.536097    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.536428 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.536410    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.542514 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.542487    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.542665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.542645    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg294\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294\") pod \"e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") " pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.583916 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.583872    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:09.888933 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.888903    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:06:09.890008 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:06:09.889979    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23dcf98_05c6_4480_a5d7_94a410632ac2.slice/crio-d7dcfa25d35d7860d3af3c3a6d79ae97e0d4d83a85f65a1167974fab3da46551 WatchSource:0}: Error finding container d7dcfa25d35d7860d3af3c3a6d79ae97e0d4d83a85f65a1167974fab3da46551: Status 404 returned error can't find the container with id d7dcfa25d35d7860d3af3c3a6d79ae97e0d4d83a85f65a1167974fab3da46551
Sep 11 19:06:09.892837 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.892803    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:09.892930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.892873    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:09.892930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:09.892903    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:10.255837 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.255796    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" event={"ID":"d23dcf98-05c6-4480-a5d7-94a410632ac2","Type":"ContainerStarted","Data":"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"}
Sep 11 19:06:10.256019 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.255856    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" event={"ID":"d23dcf98-05c6-4480-a5d7-94a410632ac2","Type":"ContainerStarted","Data":"d7dcfa25d35d7860d3af3c3a6d79ae97e0d4d83a85f65a1167974fab3da46551"}
Sep 11 19:06:10.279747 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.279679    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" podStartSLOduration=1.279653916 podStartE2EDuration="1.279653916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:06:10.275193856 +0000 UTC m=+1048.762117736" watchObservedRunningTime="2026-09-11 19:06:10.279653916 +0000 UTC m=+1048.766577796"
Sep 11 19:06:10.585048 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.584948    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:10.586812 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.586784    2587 patch_prober.go:28] interesting pod/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 11 19:06:10.586997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.586838    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 11 19:06:10.627199 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:10.627148    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:06:11.589211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:11.589178    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:12.269404 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:12.269367    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:12.270547 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:12.270521    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:06:13.808485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.808423    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:06:13.983588 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983546    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.983782 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983675    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvbzh\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.983782 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983700    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.983782 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983731    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.983782 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983753    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.984005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983795    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.984005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983865    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.984005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983889    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.984005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.983948    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token\") pod \"3674048f-97b7-47e3-8f8a-29d340159d26\" (UID: \"3674048f-97b7-47e3-8f8a-29d340159d26\") "
Sep 11 19:06:13.984214 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984071    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:13.984274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984170    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:06:13.984333 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984253    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:13.984456 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984433    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:13.984532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984440    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:13.984532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984484    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3674048f-97b7-47e3-8f8a-29d340159d26-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:13.984532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984502    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:13.984532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.984453    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data" (OuterVolumeSpecName: "istio-data") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:13.986250 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.986222    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:13.986448 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.986416    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:06:13.986551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.986493    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token" (OuterVolumeSpecName: "istio-token") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:13.986628 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:13.986555    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh" (OuterVolumeSpecName: "kube-api-access-cvbzh") pod "3674048f-97b7-47e3-8f8a-29d340159d26" (UID: "3674048f-97b7-47e3-8f8a-29d340159d26"). InnerVolumeSpecName "kube-api-access-cvbzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086079    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086107    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3674048f-97b7-47e3-8f8a-29d340159d26-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086116    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086124    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086133    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvbzh\" (UniqueName: \"kubernetes.io/projected/3674048f-97b7-47e3-8f8a-29d340159d26-kube-api-access-cvbzh\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.086163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.086143    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3674048f-97b7-47e3-8f8a-29d340159d26-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:14.284874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.284835    2587 generic.go:356] "Generic (PLEG): container finished" podID="3674048f-97b7-47e3-8f8a-29d340159d26" containerID="a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf" exitCode=0
Sep 11 19:06:14.285052 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.284923    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"
Sep 11 19:06:14.285052 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.284923    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerDied","Data":"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"}
Sep 11 19:06:14.285052 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.284986    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf" event={"ID":"3674048f-97b7-47e3-8f8a-29d340159d26","Type":"ContainerDied","Data":"250d18a2a0a5f8d8131d06d42f4f6208922a7e51c5a1e32d816da5ffeaa06a6d"}
Sep 11 19:06:14.285052 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.285011    2587 scope.go:117] "RemoveContainer" containerID="a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"
Sep 11 19:06:14.295304 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.295276    2587 scope.go:117] "RemoveContainer" containerID="c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"
Sep 11 19:06:14.305320 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.305295    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:06:14.305693 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.305672    2587 scope.go:117] "RemoveContainer" containerID="a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"
Sep 11 19:06:14.306012 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:14.305981    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf\": container with ID starting with a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf not found: ID does not exist" containerID="a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"
Sep 11 19:06:14.306103 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.306024    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf"} err="failed to get container status \"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf\": rpc error: code = NotFound desc = could not find container \"a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf\": container with ID starting with a8e0b726d697381d0ecbe8abfdad0287b8b79c266fe92512558deae47e9662bf not found: ID does not exist"
Sep 11 19:06:14.306103 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.306057    2587 scope.go:117] "RemoveContainer" containerID="c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"
Sep 11 19:06:14.306403 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:14.306382    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd\": container with ID starting with c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd not found: ID does not exist" containerID="c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"
Sep 11 19:06:14.306476 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.306408    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd"} err="failed to get container status \"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd\": rpc error: code = NotFound desc = could not find container \"c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd\": container with ID starting with c92b1ba77878b5e4c6ee525474a2c0eba4254a124d7fc6cc4fb028bf36ea04cd not found: ID does not exist"
Sep 11 19:06:14.310966 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:14.310942    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f60615-openshift-default-667c4c9cd4-6kzsf"]
Sep 11 19:06:15.997199 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:15.997167    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" path="/var/lib/kubelet/pods/3674048f-97b7-47e3-8f8a-29d340159d26/volumes"
Sep 11 19:06:16.538356 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:16.538321    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:06:16.538632 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:16.538582    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy" containerID="cri-o://798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a" gracePeriod=30
Sep 11 19:06:21.803680 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.803587    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:06:21.863437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863395    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863463    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863500    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863533    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863588    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863652    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ql5s\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863687    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863715    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863753    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy\") pod \"d0fd6230-6322-4f52-9be8-f344e5007055\" (UID: \"d0fd6230-6322-4f52-9be8-f344e5007055\") "
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863778    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863896    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:21.863924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.863911    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:21.864239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.864134    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:21.864239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.864197    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.864239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.864212    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.864239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.864223    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.864239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.864231    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:06:21.866048 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.866011    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s" (OuterVolumeSpecName: "kube-api-access-7ql5s") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "kube-api-access-7ql5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:21.866182 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.866069    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:21.866348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.866327    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:06:21.866397 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.866388    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0fd6230-6322-4f52-9be8-f344e5007055" (UID: "d0fd6230-6322-4f52-9be8-f344e5007055"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:21.965458 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965418    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.965458 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965453    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ql5s\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-kube-api-access-7ql5s\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.965706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965466    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd6230-6322-4f52-9be8-f344e5007055-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.965706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965476    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd6230-6322-4f52-9be8-f344e5007055-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.965706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965484    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd6230-6322-4f52-9be8-f344e5007055-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:21.965706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:21.965492    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd6230-6322-4f52-9be8-f344e5007055-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:22.340462 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.340421    2587 generic.go:356] "Generic (PLEG): container finished" podID="d0fd6230-6322-4f52-9be8-f344e5007055" containerID="798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a" exitCode=0
Sep 11 19:06:22.340701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.340478    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"
Sep 11 19:06:22.340701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.340512    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerDied","Data":"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"}
Sep 11 19:06:22.340701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.340579    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6" event={"ID":"d0fd6230-6322-4f52-9be8-f344e5007055","Type":"ContainerDied","Data":"33eb84e7bfb12c55247fe42c4dab97e063d6ba96485ca93fb17eb90dbb293994"}
Sep 11 19:06:22.340701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.340628    2587 scope.go:117] "RemoveContainer" containerID="798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"
Sep 11 19:06:22.350914 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.350893    2587 scope.go:117] "RemoveContainer" containerID="3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"
Sep 11 19:06:22.359523 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.359497    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:06:22.360436 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.360415    2587 scope.go:117] "RemoveContainer" containerID="798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"
Sep 11 19:06:22.360755 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:22.360733    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a\": container with ID starting with 798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a not found: ID does not exist" containerID="798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"
Sep 11 19:06:22.360814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.360766    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a"} err="failed to get container status \"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a\": rpc error: code = NotFound desc = could not find container \"798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a\": container with ID starting with 798be5961fce87da986a19e8d0af1c451b94cb31674143527c14b1a448e6e75a not found: ID does not exist"
Sep 11 19:06:22.360814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.360786    2587 scope.go:117] "RemoveContainer" containerID="3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"
Sep 11 19:06:22.361054 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:22.361038    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a\": container with ID starting with 3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a not found: ID does not exist" containerID="3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"
Sep 11 19:06:22.361093 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.361059    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a"} err="failed to get container status \"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a\": rpc error: code = NotFound desc = could not find container \"3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a\": container with ID starting with 3c2639fb2ddf1fed58ff4f10d21e8bad7a062af8d2658896ce77dc1cf63f532a not found: ID does not exist"
Sep 11 19:06:22.365175 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:22.365153    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9a60dde0-openshift-default-7ddd8989d4-2gzg6"]
Sep 11 19:06:23.996573 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:23.996537    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" path="/var/lib/kubelet/pods/d0fd6230-6322-4f52-9be8-f344e5007055/volumes"
Sep 11 19:06:27.160910 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:27.160874    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:06:31.352693 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.352647    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353152    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353167    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353180    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353186    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353198    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:31.353206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353204    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:31.353516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353277    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:31.353516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353285    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:31.353516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.353291    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:31.358341 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.358308    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.363559 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.363523    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-19647e-openshift-default-dockercfg-bkq2p\""
Sep 11 19:06:31.380103 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.380069    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:06:31.464215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464166    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464291    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464387    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464430 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464414    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464454    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464491    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464518    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464557    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.464663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.464588    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jlkh\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566137 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566091    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566137 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566137    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566158    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566185    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566216    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566250    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566282    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jlkh\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566369    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566461    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566671    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566706    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.566995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.566968    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.567128 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.567035    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.567298 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.567271    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.568877 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.568856    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.568963 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.568944    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.578657 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.578631    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.579452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.579336    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jlkh\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh\") pod \"e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") " pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.673841 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.673809    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:31.959955 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.959925    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:06:31.961061 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:06:31.961036    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9c6ca4_8c81_4df1_b8cc_c85aaa512b0f.slice/crio-c78967f02caf5f82e0fc5e36ce81e1bb733c79f60f62d86f461e1eb3623bdd0a WatchSource:0}: Error finding container c78967f02caf5f82e0fc5e36ce81e1bb733c79f60f62d86f461e1eb3623bdd0a: Status 404 returned error can't find the container with id c78967f02caf5f82e0fc5e36ce81e1bb733c79f60f62d86f461e1eb3623bdd0a
Sep 11 19:06:31.963564 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.963517    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:31.963664 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.963637    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:31.963709 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:31.963688    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:32.405172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:32.405074    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerStarted","Data":"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"}
Sep 11 19:06:32.405172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:32.405129    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerStarted","Data":"c78967f02caf5f82e0fc5e36ce81e1bb733c79f60f62d86f461e1eb3623bdd0a"}
Sep 11 19:06:32.457791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:32.457731    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podStartSLOduration=1.457713427 podStartE2EDuration="1.457713427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:06:32.454331604 +0000 UTC m=+1070.941255487" watchObservedRunningTime="2026-09-11 19:06:32.457713427 +0000 UTC m=+1070.944637367"
Sep 11 19:06:32.674699 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:32.674660    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:33.680245 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:33.680211    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:34.417323 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:34.417294    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:34.418182 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:34.418157    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:06:39.088125 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.088088    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:06:39.088674 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.088331    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" podUID="fc86cc87-2aac-43d6-9739-0f608c2c4975" containerName="maas-api" containerID="cri-o://7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d" gracePeriod=30
Sep 11 19:06:39.360082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.359911    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:06:39.451100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451069    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca\") pod \"fc86cc87-2aac-43d6-9739-0f608c2c4975\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") "
Sep 11 19:06:39.451286 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451162    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4h6g\" (UniqueName: \"kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g\") pod \"fc86cc87-2aac-43d6-9739-0f608c2c4975\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") "
Sep 11 19:06:39.451286 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451225    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs\") pod \"fc86cc87-2aac-43d6-9739-0f608c2c4975\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") "
Sep 11 19:06:39.451286 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451253    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls\") pod \"fc86cc87-2aac-43d6-9739-0f608c2c4975\" (UID: \"fc86cc87-2aac-43d6-9739-0f608c2c4975\") "
Sep 11 19:06:39.451488 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451453    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc86cc87-2aac-43d6-9739-0f608c2c4975" (UID: "fc86cc87-2aac-43d6-9739-0f608c2c4975"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:06:39.451755 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.451734    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86cc87-2aac-43d6-9739-0f608c2c4975-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:39.453470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.453436    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g" (OuterVolumeSpecName: "kube-api-access-k4h6g") pod "fc86cc87-2aac-43d6-9739-0f608c2c4975" (UID: "fc86cc87-2aac-43d6-9739-0f608c2c4975"). InnerVolumeSpecName "kube-api-access-k4h6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:39.453470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.453459    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fc86cc87-2aac-43d6-9739-0f608c2c4975" (UID: "fc86cc87-2aac-43d6-9739-0f608c2c4975"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:06:39.453644 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.453585    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc86cc87-2aac-43d6-9739-0f608c2c4975" (UID: "fc86cc87-2aac-43d6-9739-0f608c2c4975"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:06:39.456615 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.456577    2587 generic.go:356] "Generic (PLEG): container finished" podID="fc86cc87-2aac-43d6-9739-0f608c2c4975" containerID="7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d" exitCode=0
Sep 11 19:06:39.456731 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.456624    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" event={"ID":"fc86cc87-2aac-43d6-9739-0f608c2c4975","Type":"ContainerDied","Data":"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"}
Sep 11 19:06:39.456731 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.456642    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"
Sep 11 19:06:39.456731 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.456693    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg" event={"ID":"fc86cc87-2aac-43d6-9739-0f608c2c4975","Type":"ContainerDied","Data":"bc2fc27e2b8efd0db6951cff8a4373f72ff2f2061f4268f6f9259ee7660e1da2"}
Sep 11 19:06:39.456731 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.456726    2587 scope.go:117] "RemoveContainer" containerID="7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"
Sep 11 19:06:39.482274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.482249    2587 scope.go:117] "RemoveContainer" containerID="7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"
Sep 11 19:06:39.482674 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:39.482651    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d\": container with ID starting with 7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d not found: ID does not exist" containerID="7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"
Sep 11 19:06:39.482759 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.482688    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d"} err="failed to get container status \"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d\": rpc error: code = NotFound desc = could not find container \"7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d\": container with ID starting with 7d95248d824b7cfe6c9418eda0f830d7521c1dc27df3a74c4076709de715698d not found: ID does not exist"
Sep 11 19:06:39.550838 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.550802    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:06:39.552825 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.552803    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4h6g\" (UniqueName: \"kubernetes.io/projected/fc86cc87-2aac-43d6-9739-0f608c2c4975-kube-api-access-k4h6g\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:39.552890 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.552828    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:39.552890 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.552838    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc86cc87-2aac-43d6-9739-0f608c2c4975-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:39.583278 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.583249    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c6c610-86b484c549-942jg"]
Sep 11 19:06:39.996684 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:39.996651    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc86cc87-2aac-43d6-9739-0f608c2c4975" path="/var/lib/kubelet/pods/fc86cc87-2aac-43d6-9739-0f608c2c4975/volumes"
Sep 11 19:06:46.467772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:46.467725    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:06:46.468243 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:46.468013    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy" containerID="cri-o://c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835" gracePeriod=30
Sep 11 19:06:51.743000 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.742939    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:06:51.787640 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.787586    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.787840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.787692    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.787840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.787730    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv47j\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.787840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.787761    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.787840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.787802    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.788187 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788159    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:06:51.788332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788186    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:51.788332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788237    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.788332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788310    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.788509 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788338    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.788509 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788413    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token\") pod \"13129668-6195-4d46-86ae-dae26bfb8373\" (UID: \"13129668-6195-4d46-86ae-dae26bfb8373\") "
Sep 11 19:06:51.788802 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788720    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:51.788897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788811    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data" (OuterVolumeSpecName: "istio-data") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:51.788897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.788877    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:51.789179 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.789155    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13129668-6195-4d46-86ae-dae26bfb8373-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.789329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.789182    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.790548 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.790509    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:06:51.790677 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.790656    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:06:51.790738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.790674    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j" (OuterVolumeSpecName: "kube-api-access-wv47j") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "kube-api-access-wv47j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:51.790837 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.790819    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token" (OuterVolumeSpecName: "istio-token") pod "13129668-6195-4d46-86ae-dae26bfb8373" (UID: "13129668-6195-4d46-86ae-dae26bfb8373"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:06:51.890727 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890688    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv47j\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-kube-api-access-wv47j\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890727 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890722    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890727 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890733    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890742    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890750    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13129668-6195-4d46-86ae-dae26bfb8373-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890758    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13129668-6195-4d46-86ae-dae26bfb8373-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:51.890965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:51.890765    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13129668-6195-4d46-86ae-dae26bfb8373-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:06:52.560413 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.560360    2587 generic.go:356] "Generic (PLEG): container finished" podID="13129668-6195-4d46-86ae-dae26bfb8373" containerID="c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835" exitCode=0
Sep 11 19:06:52.560629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.560432    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"
Sep 11 19:06:52.560629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.560440    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerDied","Data":"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"}
Sep 11 19:06:52.560629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.560535    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj" event={"ID":"13129668-6195-4d46-86ae-dae26bfb8373","Type":"ContainerDied","Data":"3bb6d590dc049f05b73e041911914e32010440ed28910ec0b4a1d409c5a2cd09"}
Sep 11 19:06:52.560629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.560568    2587 scope.go:117] "RemoveContainer" containerID="c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"
Sep 11 19:06:52.572108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.572087    2587 scope.go:117] "RemoveContainer" containerID="9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"
Sep 11 19:06:52.589526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.589492    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:06:52.590146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.589934    2587 scope.go:117] "RemoveContainer" containerID="c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"
Sep 11 19:06:52.591034 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:52.590663    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835\": container with ID starting with c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835 not found: ID does not exist" containerID="c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"
Sep 11 19:06:52.591034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.590704    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835"} err="failed to get container status \"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835\": rpc error: code = NotFound desc = could not find container \"c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835\": container with ID starting with c7cba544f0379feaf8eb88d3b488462249b0f4102f1910aafbc2f4f9b1d0d835 not found: ID does not exist"
Sep 11 19:06:52.591034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.590730    2587 scope.go:117] "RemoveContainer" containerID="9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"
Sep 11 19:06:52.591629 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:06:52.591549    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341\": container with ID starting with 9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341 not found: ID does not exist" containerID="9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"
Sep 11 19:06:52.591629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.591580    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341"} err="failed to get container status \"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341\": rpc error: code = NotFound desc = could not find container \"9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341\": container with ID starting with 9c5dc7ba3fa5935161d2eb79f894472fe9dd06c7074630a02e0016e9b76c2341 not found: ID does not exist"
Sep 11 19:06:52.597991 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.597923    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c6c610-openshift-default-6d5c9cd588-qdttj"]
Sep 11 19:06:52.633502 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:52.633466    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:06:53.997268 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:53.997233    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13129668-6195-4d46-86ae-dae26bfb8373" path="/var/lib/kubelet/pods/13129668-6195-4d46-86ae-dae26bfb8373/volumes"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.784231    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.784958    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.784980    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785014    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc86cc87-2aac-43d6-9739-0f608c2c4975" containerName="maas-api"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785025    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc86cc87-2aac-43d6-9739-0f608c2c4975" containerName="maas-api"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785044    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785054    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="3674048f-97b7-47e3-8f8a-29d340159d26" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785159    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785174    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fd6230-6322-4f52-9be8-f344e5007055" containerName="istio-proxy"
Sep 11 19:06:54.787146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.785185    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc86cc87-2aac-43d6-9739-0f608c2c4975" containerName="maas-api"
Sep 11 19:06:54.790411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.790384    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.804526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.803176    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-37ce96-openshift-default-dockercfg-mwrl2\""
Sep 11 19:06:54.806700 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.806663    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:06:54.822020 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.821989    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822187 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822063    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822187 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822090    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822187 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822120    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4sc\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822187 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822149    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822418 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822198    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822418 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822227    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822418 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822255    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.822418 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.822311    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923301    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923355    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923380    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923422    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923517    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923586    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923652    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923947 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923684    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4sc\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923947 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923718    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.923947 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923870    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.924119 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.923982    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.924177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.924117    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.924177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.924137    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.924247 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.924218    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.925723 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.925695    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.926155 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.926138    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.932530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.932506    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:54.932769 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:54.932746    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4sc\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc\") pod \"e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") " pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:55.118616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.118500    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:55.419665 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:06:55.419631    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fc41d2_1942_4fa4_b569_992f54865525.slice/crio-bdf9b70bb0850068e169649b1892142afdc4bb44b19b93a30066cd1c0ee62df3 WatchSource:0}: Error finding container bdf9b70bb0850068e169649b1892142afdc4bb44b19b93a30066cd1c0ee62df3: Status 404 returned error can't find the container with id bdf9b70bb0850068e169649b1892142afdc4bb44b19b93a30066cd1c0ee62df3
Sep 11 19:06:55.419788 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.419676    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:06:55.422054 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.422024    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:55.422134 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.422087    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:55.422134 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.422117    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:06:55.591617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.590664    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerStarted","Data":"9679fc806b9489bd5c04c8b4276e43b9d0be82dd3e60bbf5694dacc84186fb63"}
Sep 11 19:06:55.591617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.590730    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerStarted","Data":"bdf9b70bb0850068e169649b1892142afdc4bb44b19b93a30066cd1c0ee62df3"}
Sep 11 19:06:55.616656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:55.616584    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podStartSLOduration=1.6165586269999999 podStartE2EDuration="1.616558627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:06:55.613519978 +0000 UTC m=+1094.100443859" watchObservedRunningTime="2026-09-11 19:06:55.616558627 +0000 UTC m=+1094.103482505"
Sep 11 19:06:56.119761 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:56.119716    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:56.125002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:56.124965    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:56.601965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:56.601921    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:06:56.603212 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:06:56.603186    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:07:00.914452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:00.914415    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:07:00.915541 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:00.915491    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" podUID="2d0419bc-1994-4f84-8e2b-e40d00433205" containerName="maas-api" containerID="cri-o://d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1" gracePeriod=30
Sep 11 19:07:01.202393 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.202098    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:07:01.301740 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.301705    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls\") pod \"2d0419bc-1994-4f84-8e2b-e40d00433205\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") "
Sep 11 19:07:01.301941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.301804    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4kn6\" (UniqueName: \"kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6\") pod \"2d0419bc-1994-4f84-8e2b-e40d00433205\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") "
Sep 11 19:07:01.301941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.301868    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca\") pod \"2d0419bc-1994-4f84-8e2b-e40d00433205\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") "
Sep 11 19:07:01.301941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.301910    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs\") pod \"2d0419bc-1994-4f84-8e2b-e40d00433205\" (UID: \"2d0419bc-1994-4f84-8e2b-e40d00433205\") "
Sep 11 19:07:01.302497 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.302451    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d0419bc-1994-4f84-8e2b-e40d00433205" (UID: "2d0419bc-1994-4f84-8e2b-e40d00433205"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:07:01.304795 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.304753    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2d0419bc-1994-4f84-8e2b-e40d00433205" (UID: "2d0419bc-1994-4f84-8e2b-e40d00433205"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:07:01.305362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.305323    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d0419bc-1994-4f84-8e2b-e40d00433205" (UID: "2d0419bc-1994-4f84-8e2b-e40d00433205"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:07:01.305565 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.305540    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6" (OuterVolumeSpecName: "kube-api-access-d4kn6") pod "2d0419bc-1994-4f84-8e2b-e40d00433205" (UID: "2d0419bc-1994-4f84-8e2b-e40d00433205"). InnerVolumeSpecName "kube-api-access-d4kn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:07:01.403128 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.403084    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:01.403128 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.403130    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4kn6\" (UniqueName: \"kubernetes.io/projected/2d0419bc-1994-4f84-8e2b-e40d00433205-kube-api-access-d4kn6\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:01.403358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.403146    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d0419bc-1994-4f84-8e2b-e40d00433205-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:01.403358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.403173    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0419bc-1994-4f84-8e2b-e40d00433205-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:01.635051 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.634959    2587 generic.go:356] "Generic (PLEG): container finished" podID="2d0419bc-1994-4f84-8e2b-e40d00433205" containerID="d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1" exitCode=0
Sep 11 19:07:01.635051 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.635010    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"
Sep 11 19:07:01.635051 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.635034    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" event={"ID":"2d0419bc-1994-4f84-8e2b-e40d00433205","Type":"ContainerDied","Data":"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"}
Sep 11 19:07:01.635340 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.635117    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67" event={"ID":"2d0419bc-1994-4f84-8e2b-e40d00433205","Type":"ContainerDied","Data":"fad4de33169556172c0e3fd55a4dbe81e8e5d6f4c479bc22762dccc98fd707c3"}
Sep 11 19:07:01.635340 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.635164    2587 scope.go:117] "RemoveContainer" containerID="d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"
Sep 11 19:07:01.649858 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.649798    2587 scope.go:117] "RemoveContainer" containerID="d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"
Sep 11 19:07:01.650509 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:01.650483    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1\": container with ID starting with d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1 not found: ID does not exist" containerID="d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"
Sep 11 19:07:01.651043 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.650516    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1"} err="failed to get container status \"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1\": rpc error: code = NotFound desc = could not find container \"d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1\": container with ID starting with d78228b370bf9d94ab9ad6eb834fcf58bb097f0b150cdf77db76d1546b4c20c1 not found: ID does not exist"
Sep 11 19:07:01.667029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.666988    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:07:01.672909 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:01.672871    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-093f6c-b9f6b9d7b-xtc67"]
Sep 11 19:07:02.006760 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:02.006714    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0419bc-1994-4f84-8e2b-e40d00433205" path="/var/lib/kubelet/pods/2d0419bc-1994-4f84-8e2b-e40d00433205/volumes"
Sep 11 19:07:04.419762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.419722    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:04.420217 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.419780    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:04.656007 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.655973    2587 generic.go:356] "Generic (PLEG): container finished" podID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerID="cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d" exitCode=0
Sep 11 19:07:04.656174 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.656050    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerDied","Data":"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"}
Sep 11 19:07:04.656525 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.656511    2587 scope.go:117] "RemoveContainer" containerID="cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"
Sep 11 19:07:04.657693 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.657661    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:04.657756 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.657734    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:04.657792 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:04.657766    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:05.664743 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:05.664704    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerStarted","Data":"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"}
Sep 11 19:07:05.674994 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:05.674962    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:07:05.675282 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:05.675009    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:05.675440 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:05.675419    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:06.675312 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:06.675273    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:06.675958 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:06.675924    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:07.676772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:07.676737    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:07.677386 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:07.677351    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:08.675314 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:08.675266    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:08.675524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:08.675341    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:09.247512 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.247478    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:07:09.248163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248139    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0419bc-1994-4f84-8e2b-e40d00433205" containerName="maas-api"
Sep 11 19:07:09.248254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248165    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0419bc-1994-4f84-8e2b-e40d00433205" containerName="maas-api"
Sep 11 19:07:09.248254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248206    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:07:09.248254 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248215    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:07:09.248402 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248334    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="13129668-6195-4d46-86ae-dae26bfb8373" containerName="istio-proxy"
Sep 11 19:07:09.248402 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.248351    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d0419bc-1994-4f84-8e2b-e40d00433205" containerName="maas-api"
Sep 11 19:07:09.250743 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.250719    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.253755 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.253729    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-8280eb-openshift-default-dockercfg-w9zd7\""
Sep 11 19:07:09.268444 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.268416    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402459    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402568    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402623    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbvm\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402661    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402711    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402738    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402798    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402874    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.403617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.402905    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504048 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.503956    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504048 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504027    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504061    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbvm\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504082    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504269 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504125    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504270    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504366    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504449    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504482    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504503    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504523    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504849 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504585    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.504911 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.504876    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.505197 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.505175    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.506367 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.506348    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.506860 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.506837    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.515920 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.515892    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.516075 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.516053    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbvm\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm\") pod \"e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") " pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.561675 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.561641    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:09.682781 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.682279    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:09.682781 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.682348    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:09.867756 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.867727    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:07:09.870750 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:09.870721    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c53de57_b843_4e84_bc7d_15474e366789.slice/crio-dc643a42091bbc8408a0338ad4122aefa797598230a83ea47d4677d18a124643 WatchSource:0}: Error finding container dc643a42091bbc8408a0338ad4122aefa797598230a83ea47d4677d18a124643: Status 404 returned error can't find the container with id dc643a42091bbc8408a0338ad4122aefa797598230a83ea47d4677d18a124643
Sep 11 19:07:09.873914 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.873869    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:09.874150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.874123    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:09.874305 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:09.874284    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:10.674948 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:10.674898    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:07:10.675466 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:10.674972    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 19:07:10.715010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:10.714974    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerStarted","Data":"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"}
Sep 11 19:07:10.715202 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:10.715062    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerStarted","Data":"dc643a42091bbc8408a0338ad4122aefa797598230a83ea47d4677d18a124643"}
Sep 11 19:07:10.738322 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:10.738266    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podStartSLOduration=1.738249583 podStartE2EDuration="1.738249583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:10.736359989 +0000 UTC m=+1109.223283881" watchObservedRunningTime="2026-09-11 19:07:10.738249583 +0000 UTC m=+1109.225173462"
Sep 11 19:07:11.562866 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.562823    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:11.568232 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.568203    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:11.695201 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.695165    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:07:11.696096 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.696073    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:07:11.700327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.700298    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:07:11.722573 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.722531    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:11.723310 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:11.723287    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:18.072710 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.072669    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7785-5ef971"]
Sep 11 19:07:18.076307 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.076276    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:18.078774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.078751    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jxjbf\""
Sep 11 19:07:18.090085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.090052    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-5ef971"]
Sep 11 19:07:18.204698 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.204653    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66kgj\" (UniqueName: \"kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj\") pod \"test-curl-7785-5ef971\" (UID: \"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72\") " pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:18.306304 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.306258    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66kgj\" (UniqueName: \"kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj\") pod \"test-curl-7785-5ef971\" (UID: \"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72\") " pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:18.314889 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.314839    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66kgj\" (UniqueName: \"kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj\") pod \"test-curl-7785-5ef971\" (UID: \"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72\") " pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:18.404521 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.404423    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:18.683472 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.683441    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-5ef971"]
Sep 11 19:07:18.685088 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:18.685061    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ecfd5d_a4cb_4e1c_b7ce_d94b8b320b72.slice/crio-ddad51c8ff038d932bc59775d2ae3425cc63b56dabeb3d808b58db4fe35c24fa WatchSource:0}: Error finding container ddad51c8ff038d932bc59775d2ae3425cc63b56dabeb3d808b58db4fe35c24fa: Status 404 returned error can't find the container with id ddad51c8ff038d932bc59775d2ae3425cc63b56dabeb3d808b58db4fe35c24fa
Sep 11 19:07:18.687589 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.687569    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:07:18.769950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:18.769911    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-5ef971" event={"ID":"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72","Type":"ContainerStarted","Data":"ddad51c8ff038d932bc59775d2ae3425cc63b56dabeb3d808b58db4fe35c24fa"}
Sep 11 19:07:19.780701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.780664    2587 generic.go:356] "Generic (PLEG): container finished" podID="82fc41d2-1942-4fa4-b569-992f54865525" containerID="9679fc806b9489bd5c04c8b4276e43b9d0be82dd3e60bbf5694dacc84186fb63" exitCode=0
Sep 11 19:07:19.781211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.780743    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerDied","Data":"9679fc806b9489bd5c04c8b4276e43b9d0be82dd3e60bbf5694dacc84186fb63"}
Sep 11 19:07:19.781369 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.781349    2587 scope.go:117] "RemoveContainer" containerID="9679fc806b9489bd5c04c8b4276e43b9d0be82dd3e60bbf5694dacc84186fb63"
Sep 11 19:07:19.782754 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.782716    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:19.782872 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.782801    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:19.782872 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:19.782847    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:20.808898 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:20.808736    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerStarted","Data":"7e80291e09259eb156f29acb708e8e7fe43f73f4a84f5304029a5a6dcacca37c"}
Sep 11 19:07:21.118800 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:21.118759    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:07:21.119077 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:21.119043    2587 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 19:07:21.119218 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:21.119185    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 19:07:21.817949 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:21.817908    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-5ef971" event={"ID":"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72","Type":"ContainerStarted","Data":"64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30"}
Sep 11 19:07:21.837096 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:21.837033    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7785-5ef971" podStartSLOduration=1.5055936170000002 podStartE2EDuration="3.837012394s" totalImagesPullingTime="2.331418777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:21.836624441 +0000 UTC m=+1120.323548323" watchObservedRunningTime="2026-09-11 19:07:21.837012394 +0000 UTC m=+1120.323936270"
Sep 11 19:07:22.119099 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.119004    2587 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 19:07:22.119099 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.119064    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 19:07:22.470121 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.470077    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7785-5ef971"]
Sep 11 19:07:22.475168 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.475133    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7785-5ef971"]
Sep 11 19:07:22.606988 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.606944    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7785-16f00b"]
Sep 11 19:07:22.608331 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.608297    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" containerName="test-curl-7785-5ef971"
Sep 11 19:07:22.608502 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.608490    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" containerName="test-curl-7785-5ef971"
Sep 11 19:07:22.608813 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.608795    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" containerName="test-curl-7785-5ef971"
Sep 11 19:07:22.612751 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.612730    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:22.615861 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.615826    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-16f00b"]
Sep 11 19:07:22.652488 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.652444    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgvp8\" (UniqueName: \"kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8\") pod \"test-curl-7785-16f00b\" (UID: \"df2e9d1c-2b53-4426-841b-363a0a850be6\") " pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:22.753954 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.753858    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgvp8\" (UniqueName: \"kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8\") pod \"test-curl-7785-16f00b\" (UID: \"df2e9d1c-2b53-4426-841b-363a0a850be6\") " pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:22.762536 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.762502    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgvp8\" (UniqueName: \"kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8\") pod \"test-curl-7785-16f00b\" (UID: \"df2e9d1c-2b53-4426-841b-363a0a850be6\") " pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:22.823675 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:22.823643    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7785-5ef971" container="test-curl-7785-5ef971"
Sep 11 19:07:22.926651 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:22.926614    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:23.119205 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.119166    2587 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 19:07:23.119371 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.119236    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 19:07:23.230417 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.230387    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-16f00b"]
Sep 11 19:07:23.231426 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:23.231401    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf2e9d1c_2b53_4426_841b_363a0a850be6.slice/crio-b2962911ae48a03b53f241ba656279904c8f0b8eab25229d6dcdc7f44097e8f1 WatchSource:0}: Error finding container b2962911ae48a03b53f241ba656279904c8f0b8eab25229d6dcdc7f44097e8f1: Status 404 returned error can't find the container with id b2962911ae48a03b53f241ba656279904c8f0b8eab25229d6dcdc7f44097e8f1
Sep 11 19:07:23.353586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.353553    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:07:23.834734 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.834693    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-16f00b" event={"ID":"df2e9d1c-2b53-4426-841b-363a0a850be6","Type":"ContainerStarted","Data":"fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09"}
Sep 11 19:07:23.835168 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.834746    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-16f00b" event={"ID":"df2e9d1c-2b53-4426-841b-363a0a850be6","Type":"ContainerStarted","Data":"b2962911ae48a03b53f241ba656279904c8f0b8eab25229d6dcdc7f44097e8f1"}
Sep 11 19:07:23.835168 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:23.834800    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7785-5ef971" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" containerName="test-curl-7785-5ef971" containerID="cri-o://64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30" gracePeriod=2
Sep 11 19:07:23.840650 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:23.840615    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-5ef971\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:23.895203 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:23.895150    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-5ef971\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:24.119663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.119553    2587 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 19:07:24.119663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.119633    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 19:07:24.551771 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.551708    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7785-16f00b" podStartSLOduration=2.551687811 podStartE2EDuration="2.551687811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:23.890835769 +0000 UTC m=+1122.377759648" watchObservedRunningTime="2026-09-11 19:07:24.551687811 +0000 UTC m=+1123.038611691"
Sep 11 19:07:24.554773 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.554749    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7785-16f00b"]
Sep 11 19:07:24.564334 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.564294    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7785-16f00b"]
Sep 11 19:07:24.695690 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.695648    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7785-60b0d5"]
Sep 11 19:07:24.696664 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.696635    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" containerName="test-curl-7785-16f00b"
Sep 11 19:07:24.696837 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.696823    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" containerName="test-curl-7785-16f00b"
Sep 11 19:07:24.697084 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.697069    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" containerName="test-curl-7785-16f00b"
Sep 11 19:07:24.706525 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.706398    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-60b0d5"]
Sep 11 19:07:24.706659 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.706542    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:24.790261 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.790218    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55b2j\" (UniqueName: \"kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j\") pod \"test-curl-7785-60b0d5\" (UID: \"64628bc1-2b78-4253-a3c9-44c48cf7775e\") " pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:24.841286 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:24.841204    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7785-16f00b" container="test-curl-7785-16f00b"
Sep 11 19:07:24.893515 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.893458    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55b2j\" (UniqueName: \"kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j\") pod \"test-curl-7785-60b0d5\" (UID: \"64628bc1-2b78-4253-a3c9-44c48cf7775e\") " pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:24.902283 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:24.902253    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55b2j\" (UniqueName: \"kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j\") pod \"test-curl-7785-60b0d5\" (UID: \"64628bc1-2b78-4253-a3c9-44c48cf7775e\") " pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:25.016082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.016051    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:25.119081 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.118986    2587 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 19:07:25.119081 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.119051    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 19:07:25.314031 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.313997    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-60b0d5"]
Sep 11 19:07:25.848889 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.848858    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-60b0d5" event={"ID":"64628bc1-2b78-4253-a3c9-44c48cf7775e","Type":"ContainerStarted","Data":"6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0"}
Sep 11 19:07:25.849283 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.848905    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-60b0d5" event={"ID":"64628bc1-2b78-4253-a3c9-44c48cf7775e","Type":"ContainerStarted","Data":"8db23b6861c17d36ea01645018c036b90d802dc9be80a3e53919eba321c8a7f6"}
Sep 11 19:07:25.849283 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.848927    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7785-16f00b" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" containerName="test-curl-7785-16f00b" containerID="cri-o://fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09" gracePeriod=2
Sep 11 19:07:25.864549 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:25.864514    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-16f00b\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:25.865362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:25.865324    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7785-60b0d5" podStartSLOduration=1.865308221 podStartE2EDuration="1.865308221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:25.862761436 +0000 UTC m=+1124.349685306" watchObservedRunningTime="2026-09-11 19:07:25.865308221 +0000 UTC m=+1124.352232100"
Sep 11 19:07:25.866516 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:25.866494    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-16f00b\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:26.112333 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.112266    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:26.201848 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.201812    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:07:26.202559 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.202502    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:07:26.203894 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.203872    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:07:26.218014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.217985    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66kgj\" (UniqueName: \"kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj\") pod \"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72\" (UID: \"32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72\") "
Sep 11 19:07:26.220059 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.220033    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj" (OuterVolumeSpecName: "kube-api-access-66kgj") pod "32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" (UID: "32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72"). InnerVolumeSpecName "kube-api-access-66kgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:07:26.319636 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.319469    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66kgj\" (UniqueName: \"kubernetes.io/projected/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72-kube-api-access-66kgj\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:26.544331 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.544290    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7785-60b0d5"]
Sep 11 19:07:26.551792 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.551759    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7785-60b0d5"]
Sep 11 19:07:26.665064 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.665026    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7785-ea5a8e"]
Sep 11 19:07:26.665485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.665467    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" containerName="test-curl-7785-60b0d5"
Sep 11 19:07:26.665529 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.665489    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" containerName="test-curl-7785-60b0d5"
Sep 11 19:07:26.665609 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.665584    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" containerName="test-curl-7785-60b0d5"
Sep 11 19:07:26.667842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.667823    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:26.693806 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.693775    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-ea5a8e"]
Sep 11 19:07:26.724550 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.724516    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d9nf\" (UniqueName: \"kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf\") pod \"test-curl-7785-ea5a8e\" (UID: \"a9179564-65a6-46b7-81ee-aa3995595080\") " pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:26.825710 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.825583    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d9nf\" (UniqueName: \"kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf\") pod \"test-curl-7785-ea5a8e\" (UID: \"a9179564-65a6-46b7-81ee-aa3995595080\") " pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:26.834697 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.834666    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d9nf\" (UniqueName: \"kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf\") pod \"test-curl-7785-ea5a8e\" (UID: \"a9179564-65a6-46b7-81ee-aa3995595080\") " pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:26.860329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.860295    2587 generic.go:356] "Generic (PLEG): container finished" podID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" containerID="64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30" exitCode=137
Sep 11 19:07:26.860772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.860345    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:26.860772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.860399    2587 scope.go:117] "RemoveContainer" containerID="64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30"
Sep 11 19:07:26.860909 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:26.860887    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7785-60b0d5" container="test-curl-7785-60b0d5"
Sep 11 19:07:26.869875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.869860    2587 scope.go:117] "RemoveContainer" containerID="64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30"
Sep 11 19:07:26.870218 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:26.870192    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30\": container with ID starting with 64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30 not found: ID does not exist" containerID="64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30"
Sep 11 19:07:26.870310 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:26.870218    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30"} err="failed to get container status \"64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30\": rpc error: code = NotFound desc = could not find container \"64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30\": container with ID starting with 64943892471c38ddd1aeb21fa7d6687b1b2ba37fccecaa6f395fa1a87fb1fd30 not found: ID does not exist"
Sep 11 19:07:26.871045 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:26.871016    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-5ef971\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:27.009013 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.008979    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:27.285606 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.284126    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7785-ea5a8e"]
Sep 11 19:07:27.285606 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:27.284612    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9179564_65a6_46b7_81ee_aa3995595080.slice/crio-3697737caa743df57133da90b64c67502b62b97d3ca84988b20ea6355eeeffc8 WatchSource:0}: Error finding container 3697737caa743df57133da90b64c67502b62b97d3ca84988b20ea6355eeeffc8: Status 404 returned error can't find the container with id 3697737caa743df57133da90b64c67502b62b97d3ca84988b20ea6355eeeffc8
Sep 11 19:07:27.868901 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.868858    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-ea5a8e" event={"ID":"a9179564-65a6-46b7-81ee-aa3995595080","Type":"ContainerStarted","Data":"d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4"}
Sep 11 19:07:27.869242 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.868915    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7785-ea5a8e" event={"ID":"a9179564-65a6-46b7-81ee-aa3995595080","Type":"ContainerStarted","Data":"3697737caa743df57133da90b64c67502b62b97d3ca84988b20ea6355eeeffc8"}
Sep 11 19:07:27.869997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.869972    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7785-60b0d5" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" containerName="test-curl-7785-60b0d5" containerID="cri-o://6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0" gracePeriod=2
Sep 11 19:07:27.884041 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:27.883977    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-5ef971\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:27.890616 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:27.887297    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-5ef971\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" pod="opendatahub/test-curl-7785-5ef971"
Sep 11 19:07:27.890616 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:27.887772    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7785-ea5a8e" podStartSLOduration=1.88775048 podStartE2EDuration="1.88775048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:27.882193603 +0000 UTC m=+1126.369117485" watchObservedRunningTime="2026-09-11 19:07:27.88775048 +0000 UTC m=+1126.374674360"
Sep 11 19:07:27.890616 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:27.888892    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-60b0d5\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:28.004003 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.003959    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72" path="/var/lib/kubelet/pods/32ecfd5d-a4cb-4e1c-b7ce-d94b8b320b72/volumes"
Sep 11 19:07:28.057986 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.057962    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:28.139154 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.139075    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgvp8\" (UniqueName: \"kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8\") pod \"df2e9d1c-2b53-4426-841b-363a0a850be6\" (UID: \"df2e9d1c-2b53-4426-841b-363a0a850be6\") "
Sep 11 19:07:28.141111 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.141090    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8" (OuterVolumeSpecName: "kube-api-access-cgvp8") pod "df2e9d1c-2b53-4426-841b-363a0a850be6" (UID: "df2e9d1c-2b53-4426-841b-363a0a850be6"). InnerVolumeSpecName "kube-api-access-cgvp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:07:28.240532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.240488    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgvp8\" (UniqueName: \"kubernetes.io/projected/df2e9d1c-2b53-4426-841b-363a0a850be6-kube-api-access-cgvp8\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:28.502197 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.502158    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7785-ea5a8e"]
Sep 11 19:07:28.508831 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.508799    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7785-ea5a8e"]
Sep 11 19:07:28.886142 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.886045    2587 generic.go:356] "Generic (PLEG): container finished" podID="df2e9d1c-2b53-4426-841b-363a0a850be6" containerID="fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09" exitCode=137
Sep 11 19:07:28.886692 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.886138    2587 scope.go:117] "RemoveContainer" containerID="fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09"
Sep 11 19:07:28.886816 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.886172    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:28.887159 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:28.887140    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7785-ea5a8e" container="test-curl-7785-ea5a8e"
Sep 11 19:07:28.906507 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:28.906476    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-16f00b\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:28.910747 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.910727    2587 scope.go:117] "RemoveContainer" containerID="fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09"
Sep 11 19:07:28.911054 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:28.911032    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09\": container with ID starting with fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09 not found: ID does not exist" containerID="fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09"
Sep 11 19:07:28.911119 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:28.911071    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09"} err="failed to get container status \"fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09\": rpc error: code = NotFound desc = could not find container \"fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09\": container with ID starting with fd17d7e193c45c966a5425399154387937b3d9d234d3ac096ff7802eaaed5f09 not found: ID does not exist"
Sep 11 19:07:29.411636 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.411309    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:07:29.412245 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.412218    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9179564-65a6-46b7-81ee-aa3995595080" containerName="test-curl-7785-ea5a8e"
Sep 11 19:07:29.412335 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.412249    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9179564-65a6-46b7-81ee-aa3995595080" containerName="test-curl-7785-ea5a8e"
Sep 11 19:07:29.412376 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.412350    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9179564-65a6-46b7-81ee-aa3995595080" containerName="test-curl-7785-ea5a8e"
Sep 11 19:07:29.423633 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.423416    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.426082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.426049    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:07:29.428244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.428221    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7ad53a9d-openshift-default-dockercfg-wmcwk\""
Sep 11 19:07:29.450934 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:29.450896    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-16f00b\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:29.555385 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555349    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555539 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555394    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555539 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555434    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr8f8\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555539 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555488    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555539 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555515    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555761 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555548    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555761 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555565    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555761 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555669    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.555761 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.555730    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.657361 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.657317    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.657700 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.657666    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.657834 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.657710    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.657916 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.657891    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658003 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.657987    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658110 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658091    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658226 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658211    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658361 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658344    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr8f8\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658465 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658442    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658625 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658461    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658794 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658492    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658910 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658101    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.658910 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658139    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.659083 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.658787    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.660183 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.660161    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.660633 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.660615    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.671117 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.671063    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.677754 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.677719    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr8f8\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8\") pod \"e2e-mt-7ad53a9d-openshift-default-774589976-64tsl\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") " pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.735426 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.735387    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:29.905512 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:29.905475    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7785-ea5a8e" podUID="a9179564-65a6-46b7-81ee-aa3995595080" containerName="test-curl-7785-ea5a8e" containerID="cri-o://d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4" gracePeriod=2
Sep 11 19:07:29.907490 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:29.907458    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-16f00b\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" pod="opendatahub/test-curl-7785-16f00b"
Sep 11 19:07:29.908999 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:29.908972    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-ea5a8e\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="a9179564-65a6-46b7-81ee-aa3995595080" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:30.014826 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.014786    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2e9d1c-2b53-4426-841b-363a0a850be6" path="/var/lib/kubelet/pods/df2e9d1c-2b53-4426-841b-363a0a850be6/volumes"
Sep 11 19:07:30.040413 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.040376    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:07:30.040645 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:30.040437    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2287f94d_b3f8_4c99_833a_4e11cf7092f0.slice/crio-be6b6360f8a115361381c7fabf10868aa9ba67f742dcfb1a8d7bd52529553260 WatchSource:0}: Error finding container be6b6360f8a115361381c7fabf10868aa9ba67f742dcfb1a8d7bd52529553260: Status 404 returned error can't find the container with id be6b6360f8a115361381c7fabf10868aa9ba67f742dcfb1a8d7bd52529553260
Sep 11 19:07:30.043535 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.043495    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:30.043650 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.043584    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:30.043696 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.043659    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:30.054094 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.054068    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:30.164853 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.164820    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55b2j\" (UniqueName: \"kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j\") pod \"64628bc1-2b78-4253-a3c9-44c48cf7775e\" (UID: \"64628bc1-2b78-4253-a3c9-44c48cf7775e\") "
Sep 11 19:07:30.166870 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.166836    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j" (OuterVolumeSpecName: "kube-api-access-55b2j") pod "64628bc1-2b78-4253-a3c9-44c48cf7775e" (UID: "64628bc1-2b78-4253-a3c9-44c48cf7775e"). InnerVolumeSpecName "kube-api-access-55b2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:07:30.265901 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.265803    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55b2j\" (UniqueName: \"kubernetes.io/projected/64628bc1-2b78-4253-a3c9-44c48cf7775e-kube-api-access-55b2j\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:30.915186 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.915144    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerStarted","Data":"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"}
Sep 11 19:07:30.915719 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.915209    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerStarted","Data":"be6b6360f8a115361381c7fabf10868aa9ba67f742dcfb1a8d7bd52529553260"}
Sep 11 19:07:30.916707 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.916680    2587 generic.go:356] "Generic (PLEG): container finished" podID="64628bc1-2b78-4253-a3c9-44c48cf7775e" containerID="6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0" exitCode=137
Sep 11 19:07:30.916833 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.916734    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:30.916833 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.916760    2587 scope.go:117] "RemoveContainer" containerID="6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0"
Sep 11 19:07:30.926361 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.926334    2587 scope.go:117] "RemoveContainer" containerID="6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0"
Sep 11 19:07:30.926690 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:30.926654    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0\": container with ID starting with 6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0 not found: ID does not exist" containerID="6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0"
Sep 11 19:07:30.926749 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.926690    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0"} err="failed to get container status \"6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0\": rpc error: code = NotFound desc = could not find container \"6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0\": container with ID starting with 6e256ee81402df6b83a9d346d0299e57654678e998e045d6fc052697eeb4beb0 not found: ID does not exist"
Sep 11 19:07:30.940919 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:30.940887    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-60b0d5\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:30.942530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:30.942487    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podStartSLOduration=1.942471251 podStartE2EDuration="1.942471251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:30.938721959 +0000 UTC m=+1129.425645838" watchObservedRunningTime="2026-09-11 19:07:30.942471251 +0000 UTC m=+1129.429395130"
Sep 11 19:07:31.736486 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:31.736441    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:31.741856 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:31.741827    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:31.743805 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:31.743777    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-60b0d5\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:31.925852 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:31.925827    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:31.927010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:31.926985    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:07:31.929439 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:31.929408    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-60b0d5\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:31.998313 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:31.997692    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-60b0d5\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" pod="opendatahub/test-curl-7785-60b0d5"
Sep 11 19:07:32.002657 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.002296    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64628bc1-2b78-4253-a3c9-44c48cf7775e" path="/var/lib/kubelet/pods/64628bc1-2b78-4253-a3c9-44c48cf7775e/volumes"
Sep 11 19:07:32.129325 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.129298    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:32.134438 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:32.134403    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-ea5a8e\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="a9179564-65a6-46b7-81ee-aa3995595080" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:32.189172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.189134    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d9nf\" (UniqueName: \"kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf\") pod \"a9179564-65a6-46b7-81ee-aa3995595080\" (UID: \"a9179564-65a6-46b7-81ee-aa3995595080\") "
Sep 11 19:07:32.191323 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.191294    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf" (OuterVolumeSpecName: "kube-api-access-5d9nf") pod "a9179564-65a6-46b7-81ee-aa3995595080" (UID: "a9179564-65a6-46b7-81ee-aa3995595080"). InnerVolumeSpecName "kube-api-access-5d9nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:07:32.290505 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.290406    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d9nf\" (UniqueName: \"kubernetes.io/projected/a9179564-65a6-46b7-81ee-aa3995595080-kube-api-access-5d9nf\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:07:32.933772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.933732    2587 generic.go:356] "Generic (PLEG): container finished" podID="a9179564-65a6-46b7-81ee-aa3995595080" containerID="d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4" exitCode=137
Sep 11 19:07:32.934234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.933787    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:32.934234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.933838    2587 scope.go:117] "RemoveContainer" containerID="d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4"
Sep 11 19:07:32.936337 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:32.936307    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-ea5a8e\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="a9179564-65a6-46b7-81ee-aa3995595080" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:32.944575 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.944389    2587 scope.go:117] "RemoveContainer" containerID="d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4"
Sep 11 19:07:32.944772 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:32.944750    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4\": container with ID starting with d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4 not found: ID does not exist" containerID="d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4"
Sep 11 19:07:32.944836 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:32.944782    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4"} err="failed to get container status \"d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4\": rpc error: code = NotFound desc = could not find container \"d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4\": container with ID starting with d5857aba17021205b8abaf1881b6ede0ddf4cb0253652b2644938c9cc136d1e4 not found: ID does not exist"
Sep 11 19:07:32.945068 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:32.945046    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7785-ea5a8e\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="a9179564-65a6-46b7-81ee-aa3995595080" pod="opendatahub/test-curl-7785-ea5a8e"
Sep 11 19:07:33.999463 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:33.999430    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9179564-65a6-46b7-81ee-aa3995595080" path="/var/lib/kubelet/pods/a9179564-65a6-46b7-81ee-aa3995595080/volumes"
Sep 11 19:07:34.949223 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.949191    2587 generic.go:356] "Generic (PLEG): container finished" podID="1c53de57-b843-4e84-bc7d-15474e366789" containerID="3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578" exitCode=0
Sep 11 19:07:34.949394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.949263    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerDied","Data":"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"}
Sep 11 19:07:34.949785 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.949764    2587 scope.go:117] "RemoveContainer" containerID="3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"
Sep 11 19:07:34.950976 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.950944    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:34.951085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.951013    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:34.951085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:34.951045    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:07:35.958186 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:35.958146    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerStarted","Data":"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"}
Sep 11 19:07:36.561916 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:36.561880    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:36.562127 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:36.562068    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:36.562211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:36.562127    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:37.562995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:37.562958    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:37.563394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:37.563025    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:38.562380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:38.562341    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:38.562574 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:38.562406    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:39.562209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:39.562170    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:39.562714 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:39.562229    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:40.562822 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:40.562783    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:40.563211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:40.562849    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:41.563005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:41.562964    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:07:41.563491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:41.563022    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 11 19:07:41.722842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:41.722801    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:42.567184 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:42.567152    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:42.568209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:42.568187    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:07:48.731132 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.731092    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:07:48.768390 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.768350    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:07:48.773332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.773302    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.780748 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.780717    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-3b7391-serving-cert\""
Sep 11 19:07:48.793165 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.792358    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:07:48.883834 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.883791    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.884135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.883889    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.884135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.884002    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.884135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.884033    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7bk\" (UniqueName: \"kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.985015 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.984921    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7bk\" (UniqueName: \"kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.985015 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.984988    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.985244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.985083    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.985244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.985208    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.985399 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:48.985372    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-serving-cert: secret "maas-api-e2e-shared-b-w3-3b7391-serving-cert" not found
Sep 11 19:07:48.985486 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:07:48.985463    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls podName:5dd87a03-1fb2-4bfd-aa13-c7abcc208408 nodeName:}" failed. No retries permitted until 2026-09-11 19:07:49.485441274 +0000 UTC m=+1147.972365148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls") pod "maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" (UID: "5dd87a03-1fb2-4bfd-aa13-c7abcc208408") : secret "maas-api-e2e-shared-b-w3-3b7391-serving-cert" not found
Sep 11 19:07:48.986038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.986014    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.988205 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.988180    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:48.994255 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:48.994229    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7bk\" (UniqueName: \"kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:49.488850 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:49.488797    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:49.491247 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:49.491218    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:49.694713 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:49.694669    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:49.974036 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:49.974005    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:07:49.974869 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:07:49.974839    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd87a03_1fb2_4bfd_aa13_c7abcc208408.slice/crio-f1c4a85cdbbdd484256b9776eaa5baa297e00131ba5e01bff2864374f69bc1bb WatchSource:0}: Error finding container f1c4a85cdbbdd484256b9776eaa5baa297e00131ba5e01bff2864374f69bc1bb: Status 404 returned error can't find the container with id f1c4a85cdbbdd484256b9776eaa5baa297e00131ba5e01bff2864374f69bc1bb
Sep 11 19:07:50.069265 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:50.069172    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" event={"ID":"5dd87a03-1fb2-4bfd-aa13-c7abcc208408","Type":"ContainerStarted","Data":"f1c4a85cdbbdd484256b9776eaa5baa297e00131ba5e01bff2864374f69bc1bb"}
Sep 11 19:07:51.082828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:51.082784    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" event={"ID":"5dd87a03-1fb2-4bfd-aa13-c7abcc208408","Type":"ContainerStarted","Data":"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"}
Sep 11 19:07:51.084010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:51.083979    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:07:51.107676 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:51.107609    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" podStartSLOduration=2.636311207 podStartE2EDuration="3.107564659s" totalImagesPullingTime="471.253452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:07:51.102477432 +0000 UTC m=+1149.589401302" watchObservedRunningTime="2026-09-11 19:07:51.107564659 +0000 UTC m=+1149.594488540"
Sep 11 19:07:58.112210 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:07:58.112173    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:08:00.161726 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.161691    2587 generic.go:356] "Generic (PLEG): container finished" podID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerID="77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473" exitCode=0
Sep 11 19:08:00.162144 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.161764    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerDied","Data":"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"}
Sep 11 19:08:00.162247 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.162232    2587 scope.go:117] "RemoveContainer" containerID="77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"
Sep 11 19:08:00.163519 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.163495    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:08:00.163578 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.163565    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:08:00.163633 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:00.163615    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:08:01.170582 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:01.170545    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerStarted","Data":"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"}
Sep 11 19:08:01.735768 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:01.735727    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:08:01.737171 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:01.737143    2587 patch_prober.go:28] interesting pod/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 19:08:01.737291 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:01.737197    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 19:08:01.926090 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:01.926054    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:08:02.736182 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:02.736139    2587 patch_prober.go:28] interesting pod/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 19:08:02.736569 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:02.736211    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 19:08:03.736178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:03.736145    2587 patch_prober.go:28] interesting pod/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 19:08:03.736364 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:03.736213    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 19:08:04.736462 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:04.736428    2587 patch_prober.go:28] interesting pod/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 19:08:04.736887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:04.736483    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 19:08:05.736654 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:05.736616    2587 patch_prober.go:28] interesting pod/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 11 19:08:05.737069 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:05.736678    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 11 19:08:06.740996 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:06.740964    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:08:06.742120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:06.742097    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:08:14.732008 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:14.731954    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:08:14.732437 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:14.732201    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerName="istio-proxy" containerID="cri-o://5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c" gracePeriod=30
Sep 11 19:08:19.988003 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:19.987976    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:08:20.135955 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.135913    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.135955 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.135954    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.135985    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136037    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136114    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136167    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg294\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136215    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136240    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136260    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data" (OuterVolumeSpecName: "istio-data") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:08:20.136362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136276    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:08:20.136362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136285    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token\") pod \"d23dcf98-05c6-4480-a5d7-94a410632ac2\" (UID: \"d23dcf98-05c6-4480-a5d7-94a410632ac2\") "
Sep 11 19:08:20.136653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136479    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:08:20.136653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136545    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:08:20.136653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136579    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:08:20.136859 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136834    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.136897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136861    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.136897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136876    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.136897 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136890    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d23dcf98-05c6-4480-a5d7-94a410632ac2-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.137035 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.136906    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.138460 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.138431    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:08:20.138460 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.138429    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:08:20.138655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.138485    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token" (OuterVolumeSpecName: "istio-token") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:08:20.138710 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.138691    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294" (OuterVolumeSpecName: "kube-api-access-zg294") pod "d23dcf98-05c6-4480-a5d7-94a410632ac2" (UID: "d23dcf98-05c6-4480-a5d7-94a410632ac2"). InnerVolumeSpecName "kube-api-access-zg294". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:08:20.238177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.238085    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg294\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-kube-api-access-zg294\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.238177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.238116    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.238177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.238130    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.238177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.238141    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d23dcf98-05c6-4480-a5d7-94a410632ac2-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:08:20.314215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.314180    2587 generic.go:356] "Generic (PLEG): container finished" podID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerID="5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c" exitCode=0
Sep 11 19:08:20.314411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.314239    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"
Sep 11 19:08:20.314411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.314265    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" event={"ID":"d23dcf98-05c6-4480-a5d7-94a410632ac2","Type":"ContainerDied","Data":"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"}
Sep 11 19:08:20.314411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.314341    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg" event={"ID":"d23dcf98-05c6-4480-a5d7-94a410632ac2","Type":"ContainerDied","Data":"d7dcfa25d35d7860d3af3c3a6d79ae97e0d4d83a85f65a1167974fab3da46551"}
Sep 11 19:08:20.314411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.314364    2587 scope.go:117] "RemoveContainer" containerID="5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"
Sep 11 19:08:20.327508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.327481    2587 scope.go:117] "RemoveContainer" containerID="5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"
Sep 11 19:08:20.328027 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:08:20.327961    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c\": container with ID starting with 5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c not found: ID does not exist" containerID="5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"
Sep 11 19:08:20.328027 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.327994    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c"} err="failed to get container status \"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c\": rpc error: code = NotFound desc = could not find container \"5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c\": container with ID starting with 5bdae01ae8312527ea3e214216ab3bb56504d4e9157df8621f6a9f7a293e8e1c not found: ID does not exist"
Sep 11 19:08:20.357438 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.357406    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:08:20.361961 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:20.361934    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f70e4e-openshift-default-6547b97cd6-8rxhg"]
Sep 11 19:08:21.996781 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:21.996747    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" path="/var/lib/kubelet/pods/d23dcf98-05c6-4480-a5d7-94a410632ac2/volumes"
Sep 11 19:08:23.223964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:08:23.223927    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:09:09.331522 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:09.331484    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:09:27.450563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.450531    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:09:27.451034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.451011    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerName="istio-proxy"
Sep 11 19:09:27.451034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.451023    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerName="istio-proxy"
Sep 11 19:09:27.451109 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.451093    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23dcf98-05c6-4480-a5d7-94a410632ac2" containerName="istio-proxy"
Sep 11 19:09:27.454419 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.454399    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.457811 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.457788    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8280eb\"/\"kube-root-ca.crt\""
Sep 11 19:09:27.458497 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.458475    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8280eb\"/\"auth-test-model-8280eb-kserve-self-signed-certs\""
Sep 11 19:09:27.458570 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.458517    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8280eb\"/\"default-dockercfg-5k22v\""
Sep 11 19:09:27.458639 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.458583    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8280eb\"/\"openshift-service-ca.crt\""
Sep 11 19:09:27.471624 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.471579    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:09:27.547746 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.547709    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpck6\" (UniqueName: \"kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.547942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.547760    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.547942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.547819    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.547942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.547935    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.548118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.548014    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.548118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.548047    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.648857 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.648818    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.648857 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.648857    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.648940    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649001    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649019    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649057    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpck6\" (UniqueName: \"kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649308 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649287    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649308 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649299    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.649428 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.649411    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.651364 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.651339    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.651486 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.651468    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.658419 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.658398    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpck6\" (UniqueName: \"kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6\") pod \"auth-test-model-8280eb-kserve-7776b76647-ncxrx\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") " pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:27.764520 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:27.764429    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:28.042498 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:28.042466    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:09:28.043649 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:09:28.043623    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47ac938a_8a8a_4fa9_8bcc_d106fa79be66.slice/crio-1874217a210d142e44f97867111a162d47fbd361a89d075d09a33aeb08759ce4 WatchSource:0}: Error finding container 1874217a210d142e44f97867111a162d47fbd361a89d075d09a33aeb08759ce4: Status 404 returned error can't find the container with id 1874217a210d142e44f97867111a162d47fbd361a89d075d09a33aeb08759ce4
Sep 11 19:09:28.743818 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:28.743777    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" event={"ID":"47ac938a-8a8a-4fa9-8bcc-d106fa79be66","Type":"ContainerStarted","Data":"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"}
Sep 11 19:09:28.744216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:28.743830    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" event={"ID":"47ac938a-8a8a-4fa9-8bcc-d106fa79be66","Type":"ContainerStarted","Data":"1874217a210d142e44f97867111a162d47fbd361a89d075d09a33aeb08759ce4"}
Sep 11 19:09:28.769615 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:28.767935    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" podStartSLOduration=1.767912234 podStartE2EDuration="1.767912234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:09:28.762088954 +0000 UTC m=+1247.249012833" watchObservedRunningTime="2026-09-11 19:09:28.767912234 +0000 UTC m=+1247.254836114"
Sep 11 19:09:37.765534 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:37.765450    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:37.765534 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:37.765497    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:37.781181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:37.781153    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:37.810844 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:37.810815    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:09:40.272113 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:40.272074    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:09:48.175550 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:48.175512    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:09:59.189771 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.189734    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:09:59.190184 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.189951    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" podUID="640cefa4-02d5-4e32-87da-56872333063c" containerName="maas-api" containerID="cri-o://37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898" gracePeriod=30
Sep 11 19:09:59.448420 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.448350    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:09:59.502185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.497851    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls\") pod \"640cefa4-02d5-4e32-87da-56872333063c\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") "
Sep 11 19:09:59.502185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.499984    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs\") pod \"640cefa4-02d5-4e32-87da-56872333063c\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") "
Sep 11 19:09:59.502185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.500052    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca\") pod \"640cefa4-02d5-4e32-87da-56872333063c\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") "
Sep 11 19:09:59.502185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.500077    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wwkc\" (UniqueName: \"kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc\") pod \"640cefa4-02d5-4e32-87da-56872333063c\" (UID: \"640cefa4-02d5-4e32-87da-56872333063c\") "
Sep 11 19:09:59.502185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.501944    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "640cefa4-02d5-4e32-87da-56872333063c" (UID: "640cefa4-02d5-4e32-87da-56872333063c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:09:59.504895 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.504845    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "640cefa4-02d5-4e32-87da-56872333063c" (UID: "640cefa4-02d5-4e32-87da-56872333063c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:09:59.507131 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.507080    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "640cefa4-02d5-4e32-87da-56872333063c" (UID: "640cefa4-02d5-4e32-87da-56872333063c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:09:59.507476 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.507451    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc" (OuterVolumeSpecName: "kube-api-access-2wwkc") pod "640cefa4-02d5-4e32-87da-56872333063c" (UID: "640cefa4-02d5-4e32-87da-56872333063c"). InnerVolumeSpecName "kube-api-access-2wwkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:09:59.601500 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.601448    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/640cefa4-02d5-4e32-87da-56872333063c-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:09:59.601500 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.601489    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wwkc\" (UniqueName: \"kubernetes.io/projected/640cefa4-02d5-4e32-87da-56872333063c-kube-api-access-2wwkc\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:09:59.601500 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.601499    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:09:59.601500 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.601508    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/640cefa4-02d5-4e32-87da-56872333063c-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:09:59.942869 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.942831    2587 generic.go:356] "Generic (PLEG): container finished" podID="640cefa4-02d5-4e32-87da-56872333063c" containerID="37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898" exitCode=0
Sep 11 19:09:59.943079 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.942879    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"
Sep 11 19:09:59.943079 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.942916    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" event={"ID":"640cefa4-02d5-4e32-87da-56872333063c","Type":"ContainerDied","Data":"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"}
Sep 11 19:09:59.943079 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.942981    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw" event={"ID":"640cefa4-02d5-4e32-87da-56872333063c","Type":"ContainerDied","Data":"37c37615f9a75eb363e022874d6fafc4b524e800cf8a3663581582e4ec8a050d"}
Sep 11 19:09:59.943079 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.943014    2587 scope.go:117] "RemoveContainer" containerID="37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"
Sep 11 19:09:59.953378 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.953358    2587 scope.go:117] "RemoveContainer" containerID="37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"
Sep 11 19:09:59.953700 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:09:59.953677    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898\": container with ID starting with 37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898 not found: ID does not exist" containerID="37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"
Sep 11 19:09:59.953778 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.953707    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898"} err="failed to get container status \"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898\": rpc error: code = NotFound desc = could not find container \"37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898\": container with ID starting with 37186d26db923e8ca95546acd6ef2b0b0ac270fa67fc2894b65969b14119d898 not found: ID does not exist"
Sep 11 19:09:59.967885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.967863    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:09:59.977496 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.977474    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-62499f-5cd9d75d9c-kg4rw"]
Sep 11 19:09:59.997115 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:09:59.997086    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640cefa4-02d5-4e32-87da-56872333063c" path="/var/lib/kubelet/pods/640cefa4-02d5-4e32-87da-56872333063c/volumes"
Sep 11 19:10:03.196088 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.196047    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" podUID="a54d2f34-26ed-4541-ac0c-8895e50627f6" containerName="main" containerID="cri-o://424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5" gracePeriod=45
Sep 11 19:10:03.462689 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.462621    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:10:03.544196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544162    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.544400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544231    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.544400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544276    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.544400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544292    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.544400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544337    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skrrf\" (UniqueName: \"kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.544668 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544407    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache\") pod \"a54d2f34-26ed-4541-ac0c-8895e50627f6\" (UID: \"a54d2f34-26ed-4541-ac0c-8895e50627f6\") "
Sep 11 19:10:03.545074 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544752    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home" (OuterVolumeSpecName: "home") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:03.545074 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.544895    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:03.545258 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.545111    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:03.546886 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.546855    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm" (OuterVolumeSpecName: "dshm") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:03.547148 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.547112    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf" (OuterVolumeSpecName: "kube-api-access-skrrf") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "kube-api-access-skrrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:10:03.547546 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.547518    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a54d2f34-26ed-4541-ac0c-8895e50627f6" (UID: "a54d2f34-26ed-4541-ac0c-8895e50627f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:10:03.645513 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645470    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skrrf\" (UniqueName: \"kubernetes.io/projected/a54d2f34-26ed-4541-ac0c-8895e50627f6-kube-api-access-skrrf\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.645513 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645505    2587 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-model-cache\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.645513 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645516    2587 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a54d2f34-26ed-4541-ac0c-8895e50627f6-tls-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.645513 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645524    2587 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-dshm\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.645824 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645532    2587 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-tmp-dir\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.645824 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.645539    2587 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a54d2f34-26ed-4541-ac0c-8895e50627f6-home\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:03.972709 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.972679    2587 generic.go:356] "Generic (PLEG): container finished" podID="a54d2f34-26ed-4541-ac0c-8895e50627f6" containerID="424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5" exitCode=0
Sep 11 19:10:03.972903 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.972738    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"
Sep 11 19:10:03.972903 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.972772    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" event={"ID":"a54d2f34-26ed-4541-ac0c-8895e50627f6","Type":"ContainerDied","Data":"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"}
Sep 11 19:10:03.972903 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.972823    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t" event={"ID":"a54d2f34-26ed-4541-ac0c-8895e50627f6","Type":"ContainerDied","Data":"91202f91b9cbb2bdbfc1b2b9e13ce8660d19b5018cf13cc5dbeb5598bde8045e"}
Sep 11 19:10:03.972903 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.972842    2587 scope.go:117] "RemoveContainer" containerID="424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"
Sep 11 19:10:03.982976 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.982953    2587 scope.go:117] "RemoveContainer" containerID="424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"
Sep 11 19:10:03.983318 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:10:03.983283    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5\": container with ID starting with 424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5 not found: ID does not exist" containerID="424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"
Sep 11 19:10:03.983409 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.983333    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5"} err="failed to get container status \"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5\": rpc error: code = NotFound desc = could not find container \"424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5\": container with ID starting with 424286a951c24dc515a7b91722e0fbbcc056f4d5b11fd20b113f221e1c39dcf5 not found: ID does not exist"
Sep 11 19:10:03.999180 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:03.999157    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:10:04.005375 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:04.005347    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-62499f/distinct-w0-62499f-kserve-76d6694fcf-4sq4t"]
Sep 11 19:10:05.999627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:05.999561    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54d2f34-26ed-4541-ac0c-8895e50627f6" path="/var/lib/kubelet/pods/a54d2f34-26ed-4541-ac0c-8895e50627f6/volumes"
Sep 11 19:10:06.752071 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:06.752032    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:10:06.752354 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:06.752327    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" containerID="cri-o://7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8" gracePeriod=30
Sep 11 19:10:08.522145 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:08.522105    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:10:09.843905 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:09.843864    2587 patch_prober.go:28] interesting pod/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:10:09.844347 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:09.843940    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:10:12.015524 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.015454    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:10:12.027811 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.027778    2587 generic.go:356] "Generic (PLEG): container finished" podID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerID="7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8" exitCode=0
Sep 11 19:10:12.027984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.027831    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"
Sep 11 19:10:12.027984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.027839    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerDied","Data":"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"}
Sep 11 19:10:12.027984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.027907    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn" event={"ID":"9776badb-60b8-41ed-97bc-5d3fe194b47a","Type":"ContainerDied","Data":"f9ac7a4ad208716d72c6cc21f6896ebd1ee55b02a2feb1e651cfa78f6a6f0dde"}
Sep 11 19:10:12.027984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.027938    2587 scope.go:117] "RemoveContainer" containerID="7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"
Sep 11 19:10:12.037699 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.037677    2587 scope.go:117] "RemoveContainer" containerID="c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"
Sep 11 19:10:12.049875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.049857    2587 scope.go:117] "RemoveContainer" containerID="7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"
Sep 11 19:10:12.050207 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:10:12.050182    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8\": container with ID starting with 7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8 not found: ID does not exist" containerID="7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"
Sep 11 19:10:12.050270 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.050222    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8"} err="failed to get container status \"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8\": rpc error: code = NotFound desc = could not find container \"7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8\": container with ID starting with 7c5058309301993886bc8e4940ef85d44552ebe891708c29ce91b36870349cb8 not found: ID does not exist"
Sep 11 19:10:12.050270 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.050248    2587 scope.go:117] "RemoveContainer" containerID="c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"
Sep 11 19:10:12.050509 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:10:12.050491    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2\": container with ID starting with c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2 not found: ID does not exist" containerID="c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"
Sep 11 19:10:12.050571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.050517    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2"} err="failed to get container status \"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2\": rpc error: code = NotFound desc = could not find container \"c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2\": container with ID starting with c86198b17af1b78d67c4fa39c5474ed8fc4c408dc3e426e17f0a04274691aec2 not found: ID does not exist"
Sep 11 19:10:12.136100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136067    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136165    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136184    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spg7s\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136201    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136244    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136259    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136284 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136274    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136377    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136391    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:12.136721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136422    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs\") pod \"9776badb-60b8-41ed-97bc-5d3fe194b47a\" (UID: \"9776badb-60b8-41ed-97bc-5d3fe194b47a\") "
Sep 11 19:10:12.136721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136526    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:12.136721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136570    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136776    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136714    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136915    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136936    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136953    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9776badb-60b8-41ed-97bc-5d3fe194b47a-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136965    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.136987 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.136977    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.138465 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.138442    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:10:12.138820 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.138798    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s" (OuterVolumeSpecName: "kube-api-access-spg7s") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "kube-api-access-spg7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:10:12.138939 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.138922    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:10:12.138990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.138930    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9776badb-60b8-41ed-97bc-5d3fe194b47a" (UID: "9776badb-60b8-41ed-97bc-5d3fe194b47a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:10:12.237738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.237712    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.237738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.237736    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spg7s\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-kube-api-access-spg7s\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.237738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.237746    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.237959 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.237755    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9776badb-60b8-41ed-97bc-5d3fe194b47a-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:10:12.354930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.354848    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:10:12.358515 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:12.358483    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-62499f-openshift-default-7cfd76554d-xlwpn"]
Sep 11 19:10:13.996565 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:13.996534    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" path="/var/lib/kubelet/pods/9776badb-60b8-41ed-97bc-5d3fe194b47a/volumes"
Sep 11 19:10:38.919203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:10:38.919164    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:11:03.325232 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:03.325189    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:11:24.131401 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:24.131361    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:11:39.020476 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:39.020441    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:11:39.021104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:39.020725    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy" containerID="cri-o://7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b" gracePeriod=30
Sep 11 19:11:40.846270 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:40.846231    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:11:44.284706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.284628    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:11:44.403322 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403286    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403322 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403327    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr8f8\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403388    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403408    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403449    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403482    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403534    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403579    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403616    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:11:44.403655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403643    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data\") pod \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\" (UID: \"2287f94d-b3f8-4c99-833a-4e11cf7092f0\") "
Sep 11 19:11:44.404070 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403857    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:11:44.404070 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403949    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:11:44.404070 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.403985    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:11:44.404070 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404064    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:11:44.404268 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404243    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.404327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404273    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.404327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404287    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.404327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404302    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.404327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.404314    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.405672 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.405643    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:11:44.405881 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.405857    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:11:44.406048 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.406026    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:11:44.406109 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.406027    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8" (OuterVolumeSpecName: "kube-api-access-mr8f8") pod "2287f94d-b3f8-4c99-833a-4e11cf7092f0" (UID: "2287f94d-b3f8-4c99-833a-4e11cf7092f0"). InnerVolumeSpecName "kube-api-access-mr8f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:11:44.505652 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.505583    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr8f8\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-kube-api-access-mr8f8\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.505652 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.505646    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.505652 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.505659    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.505900 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.505667    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2287f94d-b3f8-4c99-833a-4e11cf7092f0-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:11:44.609969 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.609875    2587 generic.go:356] "Generic (PLEG): container finished" podID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerID="7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b" exitCode=0
Sep 11 19:11:44.609969 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.609924    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"
Sep 11 19:11:44.610170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.609964    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerDied","Data":"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"}
Sep 11 19:11:44.610170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.610025    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl" event={"ID":"2287f94d-b3f8-4c99-833a-4e11cf7092f0","Type":"ContainerDied","Data":"be6b6360f8a115361381c7fabf10868aa9ba67f742dcfb1a8d7bd52529553260"}
Sep 11 19:11:44.610170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.610050    2587 scope.go:117] "RemoveContainer" containerID="7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"
Sep 11 19:11:44.624245 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.624219    2587 scope.go:117] "RemoveContainer" containerID="77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"
Sep 11 19:11:44.634156 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.634129    2587 scope.go:117] "RemoveContainer" containerID="7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"
Sep 11 19:11:44.634476 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:11:44.634454    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b\": container with ID starting with 7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b not found: ID does not exist" containerID="7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"
Sep 11 19:11:44.634557 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.634491    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b"} err="failed to get container status \"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b\": rpc error: code = NotFound desc = could not find container \"7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b\": container with ID starting with 7f099db528405d059dc7fa5332bc36f07d5493ebd3fba52964baea945676ca6b not found: ID does not exist"
Sep 11 19:11:44.634557 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.634518    2587 scope.go:117] "RemoveContainer" containerID="77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"
Sep 11 19:11:44.634855 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:11:44.634833    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473\": container with ID starting with 77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473 not found: ID does not exist" containerID="77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"
Sep 11 19:11:44.634908 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.634867    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473"} err="failed to get container status \"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473\": rpc error: code = NotFound desc = could not find container \"77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473\": container with ID starting with 77ccedd9c3bec8c0a3bc883261b38f1b08d1704350e0b13c106e5a6da8f9e473 not found: ID does not exist"
Sep 11 19:11:44.636957 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.636936    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:11:44.641368 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:44.641345    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7ad53a9d-openshift-default-774589976-64tsl"]
Sep 11 19:11:45.996944 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:11:45.996907    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" path="/var/lib/kubelet/pods/2287f94d-b3f8-4c99-833a-4e11cf7092f0/volumes"
Sep 11 19:12:07.124968 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:07.124924    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:12:28.314572 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:28.314533    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:12:35.731747 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.731650    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:12:35.732394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732368    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:35.732394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732393    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732414    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732423    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732436    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732446    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732461    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732487    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732503    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640cefa4-02d5-4e32-87da-56872333063c" containerName="maas-api"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732512    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="640cefa4-02d5-4e32-87da-56872333063c" containerName="maas-api"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732558    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54d2f34-26ed-4541-ac0c-8895e50627f6" containerName="main"
Sep 11 19:12:35.732627 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732568    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54d2f34-26ed-4541-ac0c-8895e50627f6" containerName="main"
Sep 11 19:12:35.733042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732714    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="640cefa4-02d5-4e32-87da-56872333063c" containerName="maas-api"
Sep 11 19:12:35.733042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732727    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.733042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732744    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:35.733042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732759    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54d2f34-26ed-4541-ac0c-8895e50627f6" containerName="main"
Sep 11 19:12:35.733042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.732768    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="9776badb-60b8-41ed-97bc-5d3fe194b47a" containerName="istio-proxy"
Sep 11 19:12:35.736225 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.736203    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.738852 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.738831    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7c10b1-openshift-default-dockercfg-4jqxl\""
Sep 11 19:12:35.751997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.751971    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:12:35.832523 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832487    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832523 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832532    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832567    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832645    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832690    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832766    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832810    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832844    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26zxg\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.832998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.832941    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933725 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933690    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933740    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933774    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933818    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933860    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933892    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.933950 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933928    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934341 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933954    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934341 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.933987    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26zxg\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934341 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.934110    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934518 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.934360    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934518 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.934478    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.934533    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.934655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.934538    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.936516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.936495    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.936884 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.936864    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.942758 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.942730    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:35.942964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:35.942948    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26zxg\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg\") pod \"e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") " pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:36.047062 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.046969    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:36.332769 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.332730    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:12:36.333692 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:12:36.333666    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc1af9c_af19_42c5_a266_a890ce61231d.slice/crio-58fedb34bc2ee24b67014dc8ea060929f4ca38c79c6b460e10f824c2c010d4fb WatchSource:0}: Error finding container 58fedb34bc2ee24b67014dc8ea060929f4ca38c79c6b460e10f824c2c010d4fb: Status 404 returned error can't find the container with id 58fedb34bc2ee24b67014dc8ea060929f4ca38c79c6b460e10f824c2c010d4fb
Sep 11 19:12:36.336157 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.336123    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:12:36.336249 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.336191    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:12:36.336249 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.336220    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:12:36.932171 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.932127    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerStarted","Data":"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"}
Sep 11 19:12:36.932687 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.932190    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerStarted","Data":"58fedb34bc2ee24b67014dc8ea060929f4ca38c79c6b460e10f824c2c010d4fb"}
Sep 11 19:12:36.955215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:36.955165    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podStartSLOduration=1.955148608 podStartE2EDuration="1.955148608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:12:36.953335827 +0000 UTC m=+1435.440259707" watchObservedRunningTime="2026-09-11 19:12:36.955148608 +0000 UTC m=+1435.442072487"
Sep 11 19:12:37.047265 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:37.047223    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:37.052475 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:37.052447    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:37.938364 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:37.938325    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:37.939279 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:37.939260    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:12:44.002715 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.002678    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:12:44.003561 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.003536    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="2287f94d-b3f8-4c99-833a-4e11cf7092f0" containerName="istio-proxy"
Sep 11 19:12:44.008358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.008336    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.010742 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.010716    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7c10b1-serving-cert\""
Sep 11 19:12:44.019657 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.019626    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:12:44.117065 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.117024    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.117065 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.117069    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.117305 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.117197    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.117305 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.117292    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvplz\" (UniqueName: \"kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.218609 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.218560    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.218814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.218633    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.218814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.218734    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.218942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.218851    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvplz\" (UniqueName: \"kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.218942 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:12:44.218887    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-serving-cert: secret "maas-api-e2e-api-a-7c10b1-serving-cert" not found
Sep 11 19:12:44.219033 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:12:44.218968    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls podName:41d7304c-bf3a-4a64-8024-0c43bdd19248 nodeName:}" failed. No retries permitted until 2026-09-11 19:12:44.718945841 +0000 UTC m=+1443.205869699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls") pod "maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" (UID: "41d7304c-bf3a-4a64-8024-0c43bdd19248") : secret "maas-api-e2e-api-a-7c10b1-serving-cert" not found
Sep 11 19:12:44.219363 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.219342    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.221040 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.221021    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.231526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.231501    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvplz\" (UniqueName: \"kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.723811 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.723777    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.726231 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.726180    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") pod \"maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:44.922448 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:44.922401    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:45.208234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:45.208201    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:12:45.208893 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:12:45.208868    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d7304c_bf3a_4a64_8024_0c43bdd19248.slice/crio-ea599544d4f36a44bd1fb1a434a9aed784ce927c4860cf464cd997e3cf8faebb WatchSource:0}: Error finding container ea599544d4f36a44bd1fb1a434a9aed784ce927c4860cf464cd997e3cf8faebb: Status 404 returned error can't find the container with id ea599544d4f36a44bd1fb1a434a9aed784ce927c4860cf464cd997e3cf8faebb
Sep 11 19:12:45.210397 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:45.210382    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:12:45.998091 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:45.998057    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" event={"ID":"41d7304c-bf3a-4a64-8024-0c43bdd19248","Type":"ContainerStarted","Data":"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"}
Sep 11 19:12:45.998252 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:45.998112    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" event={"ID":"41d7304c-bf3a-4a64-8024-0c43bdd19248","Type":"ContainerStarted","Data":"ea599544d4f36a44bd1fb1a434a9aed784ce927c4860cf464cd997e3cf8faebb"}
Sep 11 19:12:45.998252 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:45.998224    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:46.038558 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:46.038506    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" podStartSLOduration=2.413235066 podStartE2EDuration="3.038489795s" totalImagesPullingTime="625.254729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:12:46.03516359 +0000 UTC m=+1444.522087468" watchObservedRunningTime="2026-09-11 19:12:46.038489795 +0000 UTC m=+1444.525413673"
Sep 11 19:12:52.010866 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:52.010829    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:12:53.531576 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:12:53.531535    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:13:04.126296 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.126260    2587 generic.go:356] "Generic (PLEG): container finished" podID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerID="9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8" exitCode=0
Sep 11 19:13:04.126738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.126309    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerDied","Data":"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"}
Sep 11 19:13:04.126806 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.126790    2587 scope.go:117] "RemoveContainer" containerID="9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"
Sep 11 19:13:04.128068 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.128033    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:04.128170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.128106    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:04.128170 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:04.128137    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:05.135408 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:05.135365    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerStarted","Data":"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"}
Sep 11 19:13:06.048184 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:06.048145    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:13:06.049629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:06.049590    2587 patch_prober.go:28] interesting pod/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 19:13:06.049740 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:06.049661    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 19:13:07.048028 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:07.047988    2587 patch_prober.go:28] interesting pod/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 19:13:07.048452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:07.048060    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 19:13:07.939145 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:07.939086    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:13:08.048015 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:08.047980    2587 patch_prober.go:28] interesting pod/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 19:13:08.048199 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:08.048038    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 19:13:09.047194 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.047160    2587 patch_prober.go:28] interesting pod/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 19:13:09.047386 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.047225    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 19:13:09.939393 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.939354    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:13:09.942340 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.942319    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:09.944765 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.944743    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-852059-openshift-default-dockercfg-9l7dh\""
Sep 11 19:13:09.959066 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:09.959035    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:13:10.048701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.048229    2587 patch_prober.go:28] interesting pod/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 11 19:13:10.048701 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.048294    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 11 19:13:10.113167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113127    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113172    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113235    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113284    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-php8w\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113318    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113347    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113437    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113808 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113541    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.113808 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.113659    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214611 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214492    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214611 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214553    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214614    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214686    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214711    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214745    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214789    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-php8w\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.214863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214830    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.214860    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.215033    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215312 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.215224    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215312 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.215275    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215462 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.215436    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.215768 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.215740    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.217568 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.217529    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.217793 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.217762    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.224356 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.224333    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.224923 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.224864    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-php8w\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w\") pod \"e2e-api-b-852059-openshift-default-8469c6d88d-9l84f\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") " pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.253732 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.253694    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:10.542885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.542851    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:13:10.544253 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:13:10.544229    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31206050_7561_4f05_b794_791a9f2055d3.slice/crio-ad590afb39f3d49f28958724f30337fa4c6185821e1193386cd9534498eb8c16 WatchSource:0}: Error finding container ad590afb39f3d49f28958724f30337fa4c6185821e1193386cd9534498eb8c16: Status 404 returned error can't find the container with id ad590afb39f3d49f28958724f30337fa4c6185821e1193386cd9534498eb8c16
Sep 11 19:13:10.546581 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.546551    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:10.546685 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.546651    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:10.546726 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:10.546684    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:11.052272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.052241    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:13:11.053400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.053382    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:13:11.174288 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.174254    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerStarted","Data":"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"}
Sep 11 19:13:11.174478 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.174307    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerStarted","Data":"ad590afb39f3d49f28958724f30337fa4c6185821e1193386cd9534498eb8c16"}
Sep 11 19:13:11.195381 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.195332    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podStartSLOduration=2.195315867 podStartE2EDuration="2.195315867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:13:11.193873245 +0000 UTC m=+1469.680797124" watchObservedRunningTime="2026-09-11 19:13:11.195315867 +0000 UTC m=+1469.682239788"
Sep 11 19:13:11.254699 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.254662    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:11.265681 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:11.260465    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:12.181424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:12.181382    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:12.182526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:12.182503    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:13.419369 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:13.419332    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:13:14.669104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.669070    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:13:14.671724 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.671697    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.675569 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.675548    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-852059-serving-cert\""
Sep 11 19:13:14.687027 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.686997    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:13:14.762639 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.762575    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.762639 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.762642    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.762848 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.762705    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttpc\" (UniqueName: \"kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.762890 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.762842    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.863928 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.863887    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.864100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.864032    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.864100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.864052    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.864100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.864072    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttpc\" (UniqueName: \"kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.864693 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.864668    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.866577 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.866552    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.866712 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.866692    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.872659 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.872632    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttpc\" (UniqueName: \"kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc\") pod \"maas-api-e2e-api-b-852059-59b8bdf69-qn467\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:14.985796 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:14.985759    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:15.268991 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:15.268962    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:13:15.269435 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:13:15.269414    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e717ed_82d6_4aba_b92e_2e7340dec3e6.slice/crio-99492643f30ffc23b408150251e7d73c655aadad8c27755f16c2529f39834ca2 WatchSource:0}: Error finding container 99492643f30ffc23b408150251e7d73c655aadad8c27755f16c2529f39834ca2: Status 404 returned error can't find the container with id 99492643f30ffc23b408150251e7d73c655aadad8c27755f16c2529f39834ca2
Sep 11 19:13:16.208942 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:16.208902    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" event={"ID":"f8e717ed-82d6-4aba-b92e-2e7340dec3e6","Type":"ContainerStarted","Data":"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"}
Sep 11 19:13:16.209345 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:16.208957    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" event={"ID":"f8e717ed-82d6-4aba-b92e-2e7340dec3e6","Type":"ContainerStarted","Data":"99492643f30ffc23b408150251e7d73c655aadad8c27755f16c2529f39834ca2"}
Sep 11 19:13:16.209345 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:16.209112    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:22.221067 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:22.221033    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:13:22.241049 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:22.241000    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" podStartSLOduration=7.870168661 podStartE2EDuration="8.240983709s" totalImagesPullingTime="370.815048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:13:16.230784589 +0000 UTC m=+1474.717708469" watchObservedRunningTime="2026-09-11 19:13:22.240983709 +0000 UTC m=+1480.727907590"
Sep 11 19:13:41.371353 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.371266    2587 generic.go:356] "Generic (PLEG): container finished" podID="31206050-7561-4f05-b794-791a9f2055d3" containerID="2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26" exitCode=0
Sep 11 19:13:41.371353 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.371321    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerDied","Data":"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"}
Sep 11 19:13:41.371838 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.371779    2587 scope.go:117] "RemoveContainer" containerID="2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"
Sep 11 19:13:41.373180 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.373151    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:41.373256 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.373236    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:41.373304 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:41.373281    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:13:42.181620 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:42.181405    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:42.386543 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:42.386499    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerStarted","Data":"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"}
Sep 11 19:13:43.254641 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:43.254575    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:43.256005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:43.255953    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:13:43.256150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:43.256037    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 19:13:44.254317 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:44.254278    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:13:44.254727 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:44.254338    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 19:13:45.254512 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:45.254470    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:13:45.255038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:45.254530    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 19:13:46.127488 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:46.127452    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:13:46.254773 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:46.254741    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:13:46.255222 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:46.255186    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 19:13:47.254900 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:47.254860    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 19:13:47.255438 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:47.254920    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 19:13:48.258677 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:48.258637    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:48.259152 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:48.259140    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:48.259999 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:48.259975    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:13:57.002545 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.002509    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:13:57.003034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.002776    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" podUID="41d7304c-bf3a-4a64-8024-0c43bdd19248" containerName="maas-api" containerID="cri-o://077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69" gracePeriod=30
Sep 11 19:13:57.273029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.272996    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:13:57.362893 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.362851    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") pod \"41d7304c-bf3a-4a64-8024-0c43bdd19248\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") "
Sep 11 19:13:57.363088 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.362911    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca\") pod \"41d7304c-bf3a-4a64-8024-0c43bdd19248\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") "
Sep 11 19:13:57.363088 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.362974    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs\") pod \"41d7304c-bf3a-4a64-8024-0c43bdd19248\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") "
Sep 11 19:13:57.363088 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.363066    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvplz\" (UniqueName: \"kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz\") pod \"41d7304c-bf3a-4a64-8024-0c43bdd19248\" (UID: \"41d7304c-bf3a-4a64-8024-0c43bdd19248\") "
Sep 11 19:13:57.363428 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.363391    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41d7304c-bf3a-4a64-8024-0c43bdd19248" (UID: "41d7304c-bf3a-4a64-8024-0c43bdd19248"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:13:57.363970 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.363945    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41d7304c-bf3a-4a64-8024-0c43bdd19248-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:13:57.365320 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.365280    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "41d7304c-bf3a-4a64-8024-0c43bdd19248" (UID: "41d7304c-bf3a-4a64-8024-0c43bdd19248"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:13:57.365419 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.365389    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41d7304c-bf3a-4a64-8024-0c43bdd19248" (UID: "41d7304c-bf3a-4a64-8024-0c43bdd19248"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:13:57.366026 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.366004    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz" (OuterVolumeSpecName: "kube-api-access-wvplz") pod "41d7304c-bf3a-4a64-8024-0c43bdd19248" (UID: "41d7304c-bf3a-4a64-8024-0c43bdd19248"). InnerVolumeSpecName "kube-api-access-wvplz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:13:57.465531 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.465492    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:13:57.465531 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.465523    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41d7304c-bf3a-4a64-8024-0c43bdd19248-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:13:57.465531 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.465533    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvplz\" (UniqueName: \"kubernetes.io/projected/41d7304c-bf3a-4a64-8024-0c43bdd19248-kube-api-access-wvplz\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:13:57.506173 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.506136    2587 generic.go:356] "Generic (PLEG): container finished" podID="41d7304c-bf3a-4a64-8024-0c43bdd19248" containerID="077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69" exitCode=0
Sep 11 19:13:57.506380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.506178    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"
Sep 11 19:13:57.506380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.506203    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" event={"ID":"41d7304c-bf3a-4a64-8024-0c43bdd19248","Type":"ContainerDied","Data":"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"}
Sep 11 19:13:57.506380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.506253    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz" event={"ID":"41d7304c-bf3a-4a64-8024-0c43bdd19248","Type":"ContainerDied","Data":"ea599544d4f36a44bd1fb1a434a9aed784ce927c4860cf464cd997e3cf8faebb"}
Sep 11 19:13:57.506380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.506282    2587 scope.go:117] "RemoveContainer" containerID="077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"
Sep 11 19:13:57.517362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.517342    2587 scope.go:117] "RemoveContainer" containerID="077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"
Sep 11 19:13:57.517702 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:13:57.517680    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69\": container with ID starting with 077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69 not found: ID does not exist" containerID="077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"
Sep 11 19:13:57.517773 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.517712    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69"} err="failed to get container status \"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69\": rpc error: code = NotFound desc = could not find container \"077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69\": container with ID starting with 077e6fc8808970d560ad4472c46dd84a331e2c1fffb59042edfe7b9947a15e69 not found: ID does not exist"
Sep 11 19:13:57.529122 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.529098    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:13:57.533373 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.533353    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7c10b1-795f69fdc5-s88zz"]
Sep 11 19:13:57.997038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:13:57.997004    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d7304c-bf3a-4a64-8024-0c43bdd19248" path="/var/lib/kubelet/pods/41d7304c-bf3a-4a64-8024-0c43bdd19248/volumes"
Sep 11 19:14:03.777319 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:03.777287    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:14:03.777813 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:03.777513    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy" containerID="cri-o://89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68" gracePeriod=30
Sep 11 19:14:09.046896 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.046829    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:14:09.087835 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.087807    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.087835 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.087839    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.087901    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.087927    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.087951    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088002    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088082 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088052    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088093    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088121    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26zxg\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg\") pod \"ddc1af9c-af19-42c5-a266-a890ce61231d\" (UID: \"ddc1af9c-af19-42c5-a266-a890ce61231d\") "
Sep 11 19:14:09.088348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088115    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:09.088348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088240    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:09.088348 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088325    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:09.088646 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088412    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:14:09.088646 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088543    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:09.088998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.088976    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.088998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.089001    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddc1af9c-af19-42c5-a266-a890ce61231d-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.089167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.089017    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.089167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.089030    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.089167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.089044    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.090745 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.090720    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:14:09.091024 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.091004    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:09.091114 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.091037    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg" (OuterVolumeSpecName: "kube-api-access-26zxg") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "kube-api-access-26zxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:09.091352 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.091328    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddc1af9c-af19-42c5-a266-a890ce61231d" (UID: "ddc1af9c-af19-42c5-a266-a890ce61231d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:09.190642 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.190581    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.190642 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.190638    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.190642 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.190649    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddc1af9c-af19-42c5-a266-a890ce61231d-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.190892 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.190657    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26zxg\" (UniqueName: \"kubernetes.io/projected/ddc1af9c-af19-42c5-a266-a890ce61231d-kube-api-access-26zxg\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:09.599307 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.599242    2587 generic.go:356] "Generic (PLEG): container finished" podID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerID="89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68" exitCode=0
Sep 11 19:14:09.599507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.599319    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"
Sep 11 19:14:09.599507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.599318    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerDied","Data":"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"}
Sep 11 19:14:09.599507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.599444    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc" event={"ID":"ddc1af9c-af19-42c5-a266-a890ce61231d","Type":"ContainerDied","Data":"58fedb34bc2ee24b67014dc8ea060929f4ca38c79c6b460e10f824c2c010d4fb"}
Sep 11 19:14:09.599507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.599467    2587 scope.go:117] "RemoveContainer" containerID="89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"
Sep 11 19:14:09.610560 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.610542    2587 scope.go:117] "RemoveContainer" containerID="9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"
Sep 11 19:14:09.623445 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.623422    2587 scope.go:117] "RemoveContainer" containerID="89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"
Sep 11 19:14:09.623825 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:09.623805    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68\": container with ID starting with 89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68 not found: ID does not exist" containerID="89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"
Sep 11 19:14:09.623892 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.623836    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68"} err="failed to get container status \"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68\": rpc error: code = NotFound desc = could not find container \"89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68\": container with ID starting with 89ff82aaef04d89cab7a1812c8e3043ec5a1edb5118ce26f94355ff589acbe68 not found: ID does not exist"
Sep 11 19:14:09.623892 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.623871    2587 scope.go:117] "RemoveContainer" containerID="9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"
Sep 11 19:14:09.624167 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:09.624148    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8\": container with ID starting with 9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8 not found: ID does not exist" containerID="9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"
Sep 11 19:14:09.624219 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.624176    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8"} err="failed to get container status \"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8\": rpc error: code = NotFound desc = could not find container \"9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8\": container with ID starting with 9ceb845274b98bf9e8974773ddacf4f4e3118ade2378cd2cfa6a0600c9316cc8 not found: ID does not exist"
Sep 11 19:14:09.625392 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.625373    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:14:09.629273 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.629250    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7c10b1-openshift-default-85669dc848-dwmxc"]
Sep 11 19:14:09.996178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:09.996142    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" path="/var/lib/kubelet/pods/ddc1af9c-af19-42c5-a266-a890ce61231d/volumes"
Sep 11 19:14:12.405780 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:12.405746    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:14:18.535628 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.535574    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:14:18.536124 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.535848    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" podUID="bad200e9-38ba-4bba-92c0-a097ea66eab6" containerName="maas-api" containerID="cri-o://c25b3d5a5b696f9c9dab7f87476ab8084d3143f1f3c9bbbbf0ad982515fdef9b" gracePeriod=30
Sep 11 19:14:18.659775 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.659744    2587 generic.go:356] "Generic (PLEG): container finished" podID="bad200e9-38ba-4bba-92c0-a097ea66eab6" containerID="c25b3d5a5b696f9c9dab7f87476ab8084d3143f1f3c9bbbbf0ad982515fdef9b" exitCode=0
Sep 11 19:14:18.659952 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.659835    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" event={"ID":"bad200e9-38ba-4bba-92c0-a097ea66eab6","Type":"ContainerDied","Data":"c25b3d5a5b696f9c9dab7f87476ab8084d3143f1f3c9bbbbf0ad982515fdef9b"}
Sep 11 19:14:18.797135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.797064    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:14:18.899974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.899941    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca\") pod \"bad200e9-38ba-4bba-92c0-a097ea66eab6\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") "
Sep 11 19:14:18.900172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.900011    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p629\" (UniqueName: \"kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629\") pod \"bad200e9-38ba-4bba-92c0-a097ea66eab6\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") "
Sep 11 19:14:18.900172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.900047    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") pod \"bad200e9-38ba-4bba-92c0-a097ea66eab6\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") "
Sep 11 19:14:18.900172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.900144    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs\") pod \"bad200e9-38ba-4bba-92c0-a097ea66eab6\" (UID: \"bad200e9-38ba-4bba-92c0-a097ea66eab6\") "
Sep 11 19:14:18.900484 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.900411    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bad200e9-38ba-4bba-92c0-a097ea66eab6" (UID: "bad200e9-38ba-4bba-92c0-a097ea66eab6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:14:18.900610 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.900570    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bad200e9-38ba-4bba-92c0-a097ea66eab6-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:18.902495 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.902466    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bad200e9-38ba-4bba-92c0-a097ea66eab6" (UID: "bad200e9-38ba-4bba-92c0-a097ea66eab6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:14:18.902823 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.902785    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bad200e9-38ba-4bba-92c0-a097ea66eab6" (UID: "bad200e9-38ba-4bba-92c0-a097ea66eab6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:14:18.902823 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:18.902799    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629" (OuterVolumeSpecName: "kube-api-access-7p629") pod "bad200e9-38ba-4bba-92c0-a097ea66eab6" (UID: "bad200e9-38ba-4bba-92c0-a097ea66eab6"). InnerVolumeSpecName "kube-api-access-7p629". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:19.001840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.001803    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p629\" (UniqueName: \"kubernetes.io/projected/bad200e9-38ba-4bba-92c0-a097ea66eab6-kube-api-access-7p629\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:19.001840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.001835    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:19.001840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.001844    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bad200e9-38ba-4bba-92c0-a097ea66eab6-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:19.666945 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.666916    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx" event={"ID":"bad200e9-38ba-4bba-92c0-a097ea66eab6","Type":"ContainerDied","Data":"9e8bba2c6ffd1c14ac8d516d20080c6f334aa543e166715bfe1d157dca6dac17"}
Sep 11 19:14:19.666945 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.666944    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"
Sep 11 19:14:19.667385 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.666979    2587 scope.go:117] "RemoveContainer" containerID="c25b3d5a5b696f9c9dab7f87476ab8084d3143f1f3c9bbbbf0ad982515fdef9b"
Sep 11 19:14:19.691793 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.691766    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:14:19.696046 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.696018    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c1aebc-5c6587b9d6-8l2vx"]
Sep 11 19:14:19.997150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:19.997116    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad200e9-38ba-4bba-92c0-a097ea66eab6" path="/var/lib/kubelet/pods/bad200e9-38ba-4bba-92c0-a097ea66eab6/volumes"
Sep 11 19:14:21.879559 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:21.879521    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:14:21.880075 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:21.879796    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" podUID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" containerName="maas-api" containerID="cri-o://8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f" gracePeriod=30
Sep 11 19:14:22.142393 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.142327    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:14:22.238879 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.238848    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca\") pod \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") "
Sep 11 19:14:22.239047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.238943    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs\") pod \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") "
Sep 11 19:14:22.239047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.238999    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pttpc\" (UniqueName: \"kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc\") pod \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") "
Sep 11 19:14:22.239047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.239028    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls\") pod \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\" (UID: \"f8e717ed-82d6-4aba-b92e-2e7340dec3e6\") "
Sep 11 19:14:22.239280 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.239252    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8e717ed-82d6-4aba-b92e-2e7340dec3e6" (UID: "f8e717ed-82d6-4aba-b92e-2e7340dec3e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:14:22.239468 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.239448    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:22.241411 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.241388    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8e717ed-82d6-4aba-b92e-2e7340dec3e6" (UID: "f8e717ed-82d6-4aba-b92e-2e7340dec3e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:14:22.241639 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.241617    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8e717ed-82d6-4aba-b92e-2e7340dec3e6" (UID: "f8e717ed-82d6-4aba-b92e-2e7340dec3e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:14:22.241714 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.241639    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc" (OuterVolumeSpecName: "kube-api-access-pttpc") pod "f8e717ed-82d6-4aba-b92e-2e7340dec3e6" (UID: "f8e717ed-82d6-4aba-b92e-2e7340dec3e6"). InnerVolumeSpecName "kube-api-access-pttpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:22.340637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.340573    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:22.340637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.340635    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pttpc\" (UniqueName: \"kubernetes.io/projected/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-kube-api-access-pttpc\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:22.340856 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.340652    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e717ed-82d6-4aba-b92e-2e7340dec3e6-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:22.688017 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.687978    2587 generic.go:356] "Generic (PLEG): container finished" podID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" containerID="8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f" exitCode=0
Sep 11 19:14:22.688208 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.688037    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" event={"ID":"f8e717ed-82d6-4aba-b92e-2e7340dec3e6","Type":"ContainerDied","Data":"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"}
Sep 11 19:14:22.688208 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.688045    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"
Sep 11 19:14:22.688208 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.688104    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467" event={"ID":"f8e717ed-82d6-4aba-b92e-2e7340dec3e6","Type":"ContainerDied","Data":"99492643f30ffc23b408150251e7d73c655aadad8c27755f16c2529f39834ca2"}
Sep 11 19:14:22.688208 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.688125    2587 scope.go:117] "RemoveContainer" containerID="8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"
Sep 11 19:14:22.698741 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.698716    2587 scope.go:117] "RemoveContainer" containerID="8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"
Sep 11 19:14:22.699089 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:22.699064    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f\": container with ID starting with 8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f not found: ID does not exist" containerID="8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"
Sep 11 19:14:22.699148 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.699099    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f"} err="failed to get container status \"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f\": rpc error: code = NotFound desc = could not find container \"8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f\": container with ID starting with 8f60d8f54c08c34730aa9550a473fabefe25f0b7ab5523bda625dcf06a6f578f not found: ID does not exist"
Sep 11 19:14:22.710661 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.710606    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:14:22.713449 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:22.713425    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-852059-59b8bdf69-qn467"]
Sep 11 19:14:23.996845 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:23.996803    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" path="/var/lib/kubelet/pods/f8e717ed-82d6-4aba-b92e-2e7340dec3e6/volumes"
Sep 11 19:14:28.312738 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:28.312705    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:14:28.313132 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:28.312963    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" containerID="cri-o://59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12" gracePeriod=30
Sep 11 19:14:31.515814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:31.515776    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:14:33.261518 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.261473    2587 patch_prober.go:28] interesting pod/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:14:33.262005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.261589    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:14:33.575941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.575910    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:14:33.666089 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666049    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666117    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666141    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666164    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666198    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666221    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666251    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666292    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-php8w\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666399    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs\") pod \"31206050-7561-4f05-b794-791a9f2055d3\" (UID: \"31206050-7561-4f05-b794-791a9f2055d3\") "
Sep 11 19:14:33.666586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666411    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:33.666586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666422    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:33.666586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666507    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:33.666878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666633    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:14:33.666878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666779    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:33.666878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666844    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.666878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666861    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.666878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666872    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.667143 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.666887    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31206050-7561-4f05-b794-791a9f2055d3-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.668480 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.668454    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:33.668621 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.668509    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:33.668904 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.668878    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:14:33.668904 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.668893    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w" (OuterVolumeSpecName: "kube-api-access-php8w") pod "31206050-7561-4f05-b794-791a9f2055d3" (UID: "31206050-7561-4f05-b794-791a9f2055d3"). InnerVolumeSpecName "kube-api-access-php8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:33.757724 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.757687    2587 generic.go:356] "Generic (PLEG): container finished" podID="31206050-7561-4f05-b794-791a9f2055d3" containerID="59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12" exitCode=0
Sep 11 19:14:33.757906 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.757734    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"
Sep 11 19:14:33.757906 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.757769    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerDied","Data":"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"}
Sep 11 19:14:33.757906 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.757823    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f" event={"ID":"31206050-7561-4f05-b794-791a9f2055d3","Type":"ContainerDied","Data":"ad590afb39f3d49f28958724f30337fa4c6185821e1193386cd9534498eb8c16"}
Sep 11 19:14:33.757906 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.757847    2587 scope.go:117] "RemoveContainer" containerID="59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"
Sep 11 19:14:33.767795 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767777    2587 scope.go:117] "RemoveContainer" containerID="2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"
Sep 11 19:14:33.767922 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767902    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.767995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767926    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.767995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767941    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31206050-7561-4f05-b794-791a9f2055d3-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.767995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767953    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31206050-7561-4f05-b794-791a9f2055d3-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.767995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.767967    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-php8w\" (UniqueName: \"kubernetes.io/projected/31206050-7561-4f05-b794-791a9f2055d3-kube-api-access-php8w\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:33.777435 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.777413    2587 scope.go:117] "RemoveContainer" containerID="59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"
Sep 11 19:14:33.777849 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:33.777828    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12\": container with ID starting with 59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12 not found: ID does not exist" containerID="59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"
Sep 11 19:14:33.777970 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.777859    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12"} err="failed to get container status \"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12\": rpc error: code = NotFound desc = could not find container \"59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12\": container with ID starting with 59daa92b05831fb885eb5ece65b4267266b218bf0acb5039ba962eda58ce1f12 not found: ID does not exist"
Sep 11 19:14:33.777970 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.777879    2587 scope.go:117] "RemoveContainer" containerID="2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"
Sep 11 19:14:33.778227 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:33.778164    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26\": container with ID starting with 2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26 not found: ID does not exist" containerID="2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"
Sep 11 19:14:33.778327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.778237    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26"} err="failed to get container status \"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26\": rpc error: code = NotFound desc = could not find container \"2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26\": container with ID starting with 2e0d58b7737c5e8b1812245107396faa332fcd6c4e20143c4dc3a2d798a47d26 not found: ID does not exist"
Sep 11 19:14:33.779729 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.779707    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:14:33.782275 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.782256    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-852059-openshift-default-8469c6d88d-9l84f"]
Sep 11 19:14:33.996196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:33.996166    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31206050-7561-4f05-b794-791a9f2055d3" path="/var/lib/kubelet/pods/31206050-7561-4f05-b794-791a9f2055d3/volumes"
Sep 11 19:14:37.040958 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:37.040917    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:14:45.980564 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:45.980525    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:14:45.981135 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:45.980761    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy" containerID="cri-o://a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe" gracePeriod=30
Sep 11 19:14:46.536031 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.535988    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" podUID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" containerName="main" containerID="cri-o://9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9" gracePeriod=45
Sep 11 19:14:46.810034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.810008    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:14:46.843394 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.843362    2587 generic.go:356] "Generic (PLEG): container finished" podID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" containerID="9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9" exitCode=0
Sep 11 19:14:46.843571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.843409    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"
Sep 11 19:14:46.843571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.843439    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" event={"ID":"47ac938a-8a8a-4fa9-8bcc-d106fa79be66","Type":"ContainerDied","Data":"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"}
Sep 11 19:14:46.843571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.843484    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx" event={"ID":"47ac938a-8a8a-4fa9-8bcc-d106fa79be66","Type":"ContainerDied","Data":"1874217a210d142e44f97867111a162d47fbd361a89d075d09a33aeb08759ce4"}
Sep 11 19:14:46.843571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.843505    2587 scope.go:117] "RemoveContainer" containerID="9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"
Sep 11 19:14:46.853883 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.853864    2587 scope.go:117] "RemoveContainer" containerID="9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"
Sep 11 19:14:46.854186 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:46.854159    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9\": container with ID starting with 9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9 not found: ID does not exist" containerID="9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"
Sep 11 19:14:46.854262 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.854201    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9"} err="failed to get container status \"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9\": rpc error: code = NotFound desc = could not find container \"9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9\": container with ID starting with 9a2abb0f7f1cbbfafe29fe7d8b0969d068a2c21c65bdd734bd9746e31fa8eec9 not found: ID does not exist"
Sep 11 19:14:46.903577 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903542    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.903791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903588    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.903791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903698    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpck6\" (UniqueName: \"kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.903791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903715    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.903791 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903756    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.904010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903859    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home" (OuterVolumeSpecName: "home") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:46.904010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.903901    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir\") pod \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\" (UID: \"47ac938a-8a8a-4fa9-8bcc-d106fa79be66\") "
Sep 11 19:14:46.904122 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.904047    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache" (OuterVolumeSpecName: "model-cache") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:46.904178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.904129    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:46.904386 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.904357    2587 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-model-cache\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:46.904386 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.904382    2587 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tmp-dir\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:46.904532 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.904394    2587 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-home\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:46.905849 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.905828    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm" (OuterVolumeSpecName: "dshm") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:46.905934 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.905907    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6" (OuterVolumeSpecName: "kube-api-access-tpck6") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "kube-api-access-tpck6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:46.906038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:46.906021    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47ac938a-8a8a-4fa9-8bcc-d106fa79be66" (UID: "47ac938a-8a8a-4fa9-8bcc-d106fa79be66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:14:47.005477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.005432    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpck6\" (UniqueName: \"kubernetes.io/projected/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-kube-api-access-tpck6\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:47.005477 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.005474    2587 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-tls-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:47.005910 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.005488    2587 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47ac938a-8a8a-4fa9-8bcc-d106fa79be66-dshm\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:47.164963 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.164929    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:14:47.168902 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.168875    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8280eb/auth-test-model-8280eb-kserve-7776b76647-ncxrx"]
Sep 11 19:14:47.998018 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:47.997981    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" path="/var/lib/kubelet/pods/47ac938a-8a8a-4fa9-8bcc-d106fa79be66/volumes"
Sep 11 19:14:51.008820 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.008792    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:14:51.250930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.250868    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:14:51.345998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.345958    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jlkh\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346025    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346072    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346107    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346125    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346160    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346200 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346184    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346227    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346276    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token\") pod \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\" (UID: \"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f\") "
Sep 11 19:14:51.346526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346377    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:51.346526 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346409    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:51.346774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346624    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:51.346774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346533    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:14:51.346774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346732    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:51.346774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346756    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.346774 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346775    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.346997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346788    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.346997 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.346804    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.348314 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.348288    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh" (OuterVolumeSpecName: "kube-api-access-8jlkh") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "kube-api-access-8jlkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:51.348314 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.348310    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:14:51.348757 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.348739    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:14:51.348810 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.348756    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" (UID: "eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:14:51.447978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.447927    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.447978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.447973    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.447978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.447983    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.447978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.447994    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.448266 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.448003    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jlkh\" (UniqueName: \"kubernetes.io/projected/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f-kube-api-access-8jlkh\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:14:51.892216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.886814    2587 generic.go:356] "Generic (PLEG): container finished" podID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerID="a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe" exitCode=0
Sep 11 19:14:51.892216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.886940    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerDied","Data":"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"}
Sep 11 19:14:51.892216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.886993    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785" event={"ID":"eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f","Type":"ContainerDied","Data":"c78967f02caf5f82e0fc5e36ce81e1bb733c79f60f62d86f461e1eb3623bdd0a"}
Sep 11 19:14:51.892216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.887028    2587 scope.go:117] "RemoveContainer" containerID="a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"
Sep 11 19:14:51.892216 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.887193    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"
Sep 11 19:14:51.905998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.905746    2587 scope.go:117] "RemoveContainer" containerID="cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"
Sep 11 19:14:51.925067 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.925047    2587 scope.go:117] "RemoveContainer" containerID="a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"
Sep 11 19:14:51.925807 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:51.925567    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe\": container with ID starting with a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe not found: ID does not exist" containerID="a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"
Sep 11 19:14:51.925807 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.925715    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe"} err="failed to get container status \"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe\": rpc error: code = NotFound desc = could not find container \"a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe\": container with ID starting with a72364f746a9dcb84144abe6a3e99ac4101035c2d82ed596b930ef93879492fe not found: ID does not exist"
Sep 11 19:14:51.925807 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.925742    2587 scope.go:117] "RemoveContainer" containerID="cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"
Sep 11 19:14:51.926402 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:14:51.926317    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d\": container with ID starting with cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d not found: ID does not exist" containerID="cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"
Sep 11 19:14:51.926402 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.926346    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d"} err="failed to get container status \"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d\": rpc error: code = NotFound desc = could not find container \"cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d\": container with ID starting with cf916424bc384c077c2065c5613d6826944906c8b681d74b2b1e1cb5bd2a5f9d not found: ID does not exist"
Sep 11 19:14:51.928839 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.928818    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:14:51.931851 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:51.931822    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-19647e-openshift-default-67c648f8c4-r4785"]
Sep 11 19:14:52.001274 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:14:52.001227    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" path="/var/lib/kubelet/pods/eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f/volumes"
Sep 11 19:15:00.904507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:00.904466    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:15:03.754199 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:03.754168    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:15:03.754697 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:03.754405    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy" containerID="cri-o://7e80291e09259eb156f29acb708e8e7fe43f73f4a84f5304029a5a6dcacca37c" gracePeriod=30
Sep 11 19:15:08.993891 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:08.993858    2587 generic.go:356] "Generic (PLEG): container finished" podID="82fc41d2-1942-4fa4-b569-992f54865525" containerID="7e80291e09259eb156f29acb708e8e7fe43f73f4a84f5304029a5a6dcacca37c" exitCode=0
Sep 11 19:15:08.994333 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:08.993929    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerDied","Data":"7e80291e09259eb156f29acb708e8e7fe43f73f4a84f5304029a5a6dcacca37c"}
Sep 11 19:15:08.994333 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:08.994000    2587 scope.go:117] "RemoveContainer" containerID="9679fc806b9489bd5c04c8b4276e43b9d0be82dd3e60bbf5694dacc84186fb63"
Sep 11 19:15:09.029948 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.029886    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:15:09.130720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130680    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130727    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130755    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130774    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130810    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh4sc\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130838    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130858    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130901    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.130990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.130968    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy\") pod \"82fc41d2-1942-4fa4-b569-992f54865525\" (UID: \"82fc41d2-1942-4fa4-b569-992f54865525\") "
Sep 11 19:15:09.131421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131006    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:15:09.131421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131178    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:15:09.131421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131286    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:15:09.131421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131296    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:15:09.131421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131414    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data" (OuterVolumeSpecName: "istio-data") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:15:09.131734 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131465    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.131734 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.131484    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.133108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.133084    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token" (OuterVolumeSpecName: "istio-token") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:15:09.133214 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.133135    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:15:09.133264 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.133236    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc" (OuterVolumeSpecName: "kube-api-access-bh4sc") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "kube-api-access-bh4sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:15:09.133304 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.133270    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82fc41d2-1942-4fa4-b569-992f54865525" (UID: "82fc41d2-1942-4fa4-b569-992f54865525"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:15:09.232149 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232112    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh4sc\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-kube-api-access-bh4sc\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232149 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232146    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232149 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232155    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82fc41d2-1942-4fa4-b569-992f54865525-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232381 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232163    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232381 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232170    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82fc41d2-1942-4fa4-b569-992f54865525-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232381 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232179    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82fc41d2-1942-4fa4-b569-992f54865525-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:09.232381 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:09.232188    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82fc41d2-1942-4fa4-b569-992f54865525-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:15:10.000452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:10.000411    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v" event={"ID":"82fc41d2-1942-4fa4-b569-992f54865525","Type":"ContainerDied","Data":"bdf9b70bb0850068e169649b1892142afdc4bb44b19b93a30066cd1c0ee62df3"}
Sep 11 19:15:10.000930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:10.000470    2587 scope.go:117] "RemoveContainer" containerID="7e80291e09259eb156f29acb708e8e7fe43f73f4a84f5304029a5a6dcacca37c"
Sep 11 19:15:10.000930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:10.000427    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"
Sep 11 19:15:10.020715 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:10.020687    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:15:10.024321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:10.024295    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ce96-openshift-default-7d77bf6798-6zx2v"]
Sep 11 19:15:11.996706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:11.996664    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82fc41d2-1942-4fa4-b569-992f54865525" path="/var/lib/kubelet/pods/82fc41d2-1942-4fa4-b569-992f54865525/volumes"
Sep 11 19:15:18.505512 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:18.505470    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:15:42.409984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:42.409944    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:15:57.701508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:15:57.701468    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:16:01.009051 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009014    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-c9a35d"]
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009418    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009430    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009442    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d7304c-bf3a-4a64-8024-0c43bdd19248" containerName="maas-api"
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009448    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d7304c-bf3a-4a64-8024-0c43bdd19248" containerName="maas-api"
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009457    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009461 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009463    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009469    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad200e9-38ba-4bba-92c0-a097ea66eab6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009478    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad200e9-38ba-4bba-92c0-a097ea66eab6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009484    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009490    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009505    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009512    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009519    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009524    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009530    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009535    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009542    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" containerName="main"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009547    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" containerName="main"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009559    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009564    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009571    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009576    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009659    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e717ed-82d6-4aba-b92e-2e7340dec3e6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009670    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009677    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009683    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009689    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009695    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="82fc41d2-1942-4fa4-b569-992f54865525" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009700    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d7304c-bf3a-4a64-8024-0c43bdd19248" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009705    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9c6ca4-8c81-4df1-b8cc-c85aaa512b0f" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009709    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009714    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="47ac938a-8a8a-4fa9-8bcc-d106fa79be66" containerName="main"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009719    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad200e9-38ba-4bba-92c0-a097ea66eab6" containerName="maas-api"
Sep 11 19:16:01.009721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.009724    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc1af9c-af19-42c5-a266-a890ce61231d" containerName="istio-proxy"
Sep 11 19:16:01.013034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.013005    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:01.015106 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.015034    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jxjbf\""
Sep 11 19:16:01.016586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.016562    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-c9a35d"]
Sep 11 19:16:01.149563 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.149519    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5xcz\" (UniqueName: \"kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz\") pod \"test-curl-7788-c9a35d\" (UID: \"ef0272f0-4995-4300-9d1d-319b48457a08\") " pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:01.250804 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.250757    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5xcz\" (UniqueName: \"kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz\") pod \"test-curl-7788-c9a35d\" (UID: \"ef0272f0-4995-4300-9d1d-319b48457a08\") " pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:01.257943 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.257906    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5xcz\" (UniqueName: \"kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz\") pod \"test-curl-7788-c9a35d\" (UID: \"ef0272f0-4995-4300-9d1d-319b48457a08\") " pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:01.324742 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.324641    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:01.594647 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:01.594614    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-c9a35d"]
Sep 11 19:16:01.596283 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:16:01.596257    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef0272f0_4995_4300_9d1d_319b48457a08.slice/crio-2f868b53ce4fcd44afe9f3481cc5a2b3f259bd5bc108092ca57ca7f0f20f617d WatchSource:0}: Error finding container 2f868b53ce4fcd44afe9f3481cc5a2b3f259bd5bc108092ca57ca7f0f20f617d: Status 404 returned error can't find the container with id 2f868b53ce4fcd44afe9f3481cc5a2b3f259bd5bc108092ca57ca7f0f20f617d
Sep 11 19:16:02.311733 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:02.311695    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-c9a35d" event={"ID":"ef0272f0-4995-4300-9d1d-319b48457a08","Type":"ContainerStarted","Data":"27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3"}
Sep 11 19:16:02.311733 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:02.311741    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-c9a35d" event={"ID":"ef0272f0-4995-4300-9d1d-319b48457a08","Type":"ContainerStarted","Data":"2f868b53ce4fcd44afe9f3481cc5a2b3f259bd5bc108092ca57ca7f0f20f617d"}
Sep 11 19:16:02.326153 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:02.326096    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-c9a35d" podStartSLOduration=2.326079961 podStartE2EDuration="2.326079961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:16:02.324333774 +0000 UTC m=+1640.811257652" watchObservedRunningTime="2026-09-11 19:16:02.326079961 +0000 UTC m=+1640.813003840"
Sep 11 19:16:02.893331 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:02.893289    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-c9a35d"]
Sep 11 19:16:02.897388 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:02.897348    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-c9a35d"]
Sep 11 19:16:03.005162 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005075    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-6d2715"]
Sep 11 19:16:03.005546 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005531    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" containerName="test-curl-7788-c9a35d"
Sep 11 19:16:03.005588 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005548    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" containerName="test-curl-7788-c9a35d"
Sep 11 19:16:03.005588 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005559    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:03.005588 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005565    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="31206050-7561-4f05-b794-791a9f2055d3" containerName="istio-proxy"
Sep 11 19:16:03.005706 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.005671    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" containerName="test-curl-7788-c9a35d"
Sep 11 19:16:03.008879 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.008860    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:03.013362 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.013331    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-6d2715"]
Sep 11 19:16:03.169281 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.169241    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-544hl\" (UniqueName: \"kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl\") pod \"test-curl-7788-6d2715\" (UID: \"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55\") " pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:03.270665 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.270538    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-544hl\" (UniqueName: \"kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl\") pod \"test-curl-7788-6d2715\" (UID: \"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55\") " pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:03.277892 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.277867    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-544hl\" (UniqueName: \"kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl\") pod \"test-curl-7788-6d2715\" (UID: \"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55\") " pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:03.317956 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:03.317925    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-c9a35d" container="test-curl-7788-c9a35d"
Sep 11 19:16:03.320680 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.320658    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:03.589877 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:03.589849    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-6d2715"]
Sep 11 19:16:03.591367 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:16:03.591343    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a1ad8ed_a8dc_4ee9_b149_c63ca6c82b55.slice/crio-c9f07410c9416f8ddaa1dd970727e1e2bd6bf99174c5a9fea91d9772d63db269 WatchSource:0}: Error finding container c9f07410c9416f8ddaa1dd970727e1e2bd6bf99174c5a9fea91d9772d63db269: Status 404 returned error can't find the container with id c9f07410c9416f8ddaa1dd970727e1e2bd6bf99174c5a9fea91d9772d63db269
Sep 11 19:16:04.324998 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.324960    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-6d2715" event={"ID":"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55","Type":"ContainerStarted","Data":"ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1"}
Sep 11 19:16:04.325469 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.325006    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-6d2715" event={"ID":"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55","Type":"ContainerStarted","Data":"c9f07410c9416f8ddaa1dd970727e1e2bd6bf99174c5a9fea91d9772d63db269"}
Sep 11 19:16:04.325469 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.325161    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-c9a35d" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" containerName="test-curl-7788-c9a35d" containerID="cri-o://27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3" gracePeriod=2
Sep 11 19:16:04.339456 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.339399    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-6d2715" podStartSLOduration=2.339383395 podStartE2EDuration="2.339383395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:16:04.337486618 +0000 UTC m=+1642.824410500" watchObservedRunningTime="2026-09-11 19:16:04.339383395 +0000 UTC m=+1642.826307273"
Sep 11 19:16:04.890856 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.890817    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-6d2715"]
Sep 11 19:16:04.895452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:04.895408    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-6d2715"]
Sep 11 19:16:05.338533 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:05.338501    2587 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-6d2715" container="test-curl-7788-6d2715"
Sep 11 19:16:06.344087 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:06.344053    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-6d2715" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" containerName="test-curl-7788-6d2715" containerID="cri-o://ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1" gracePeriod=2
Sep 11 19:16:06.500603 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:06.500571    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:06.604144 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:06.604028    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5xcz\" (UniqueName: \"kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz\") pod \"ef0272f0-4995-4300-9d1d-319b48457a08\" (UID: \"ef0272f0-4995-4300-9d1d-319b48457a08\") "
Sep 11 19:16:06.606176 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:06.606149    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz" (OuterVolumeSpecName: "kube-api-access-h5xcz") pod "ef0272f0-4995-4300-9d1d-319b48457a08" (UID: "ef0272f0-4995-4300-9d1d-319b48457a08"). InnerVolumeSpecName "kube-api-access-h5xcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:16:06.705485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:06.705439    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5xcz\" (UniqueName: \"kubernetes.io/projected/ef0272f0-4995-4300-9d1d-319b48457a08-kube-api-access-h5xcz\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:16:07.351541 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.351502    2587 generic.go:356] "Generic (PLEG): container finished" podID="ef0272f0-4995-4300-9d1d-319b48457a08" containerID="27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3" exitCode=137
Sep 11 19:16:07.351957 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.351549    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:07.351957 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.351569    2587 scope.go:117] "RemoveContainer" containerID="27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3"
Sep 11 19:16:07.362243 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:07.362207    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-c9a35d\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" pod="opendatahub/test-curl-7788-c9a35d"
Sep 11 19:16:07.362325 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.362248    2587 scope.go:117] "RemoveContainer" containerID="27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3"
Sep 11 19:16:07.362555 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:07.362537    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3\": container with ID starting with 27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3 not found: ID does not exist" containerID="27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3"
Sep 11 19:16:07.362652 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.362566    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3"} err="failed to get container status \"27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3\": rpc error: code = NotFound desc = could not find container \"27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3\": container with ID starting with 27ef5fdde56bc2092eca4784fdcfa807b3a1e432c42b2c1fbfe221682afd44c3 not found: ID does not exist"
Sep 11 19:16:07.996309 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:07.996272    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0272f0-4995-4300-9d1d-319b48457a08" path="/var/lib/kubelet/pods/ef0272f0-4995-4300-9d1d-319b48457a08/volumes"
Sep 11 19:16:08.538201 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:08.538165    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:08.625067 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:08.624965    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-544hl\" (UniqueName: \"kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl\") pod \"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55\" (UID: \"7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55\") "
Sep 11 19:16:08.627188 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:08.627158    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl" (OuterVolumeSpecName: "kube-api-access-544hl") pod "7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" (UID: "7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55"). InnerVolumeSpecName "kube-api-access-544hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:16:08.726450 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:08.726411    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-544hl\" (UniqueName: \"kubernetes.io/projected/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55-kube-api-access-544hl\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:16:09.366292 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.366249    2587 generic.go:356] "Generic (PLEG): container finished" podID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" containerID="ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1" exitCode=137
Sep 11 19:16:09.366476 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.366298    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:09.366476 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.366344    2587 scope.go:117] "RemoveContainer" containerID="ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1"
Sep 11 19:16:09.375755 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.375732    2587 scope.go:117] "RemoveContainer" containerID="ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1"
Sep 11 19:16:09.376029 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:09.376012    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1\": container with ID starting with ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1 not found: ID does not exist" containerID="ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1"
Sep 11 19:16:09.376085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.376037    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1"} err="failed to get container status \"ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1\": rpc error: code = NotFound desc = could not find container \"ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1\": container with ID starting with ca5cc6b11274567529ad76a72863b1de753833110399a85e6c5f120885031cc1 not found: ID does not exist"
Sep 11 19:16:09.376671 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:16:09.376647    2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-6d2715\" is forbidden: User \"system:node:ip-10-0-134-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-233.ec2.internal' and this object" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" pod="opendatahub/test-curl-7788-6d2715"
Sep 11 19:16:09.995867 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:09.995829    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" path="/var/lib/kubelet/pods/7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55/volumes"
Sep 11 19:16:10.804564 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:10.804524    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:16:21.203513 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:16:21.203472    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:17:14.707767 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:17:14.707724    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:17:46.502209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:17:46.502160    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:18:01.204990 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:01.204948    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:18:09.144629 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.144570    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:18:09.145370 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.145172    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" containerName="test-curl-7788-6d2715"
Sep 11 19:18:09.145370 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.145189    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" containerName="test-curl-7788-6d2715"
Sep 11 19:18:09.145370 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.145277    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1ad8ed-a8dc-4ee9-b149-c63ca6c82b55" containerName="test-curl-7788-6d2715"
Sep 11 19:18:09.148743 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.148720    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.151005 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.150982    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-021613-openshift-default-dockercfg-7zf4m\""
Sep 11 19:18:09.158604 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.158564    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:18:09.296204 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296161    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296432 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296230    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296432 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296274    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296432 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296352    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296432 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296383    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296480    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296532    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qttfl\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296617    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.296656 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.296651    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.397907 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.397817    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.397907 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.397891    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.397926    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qttfl\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.397981    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398015    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398146 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398108    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398148    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398189    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398238    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398581 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398554    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398682 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398658    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398749 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398664    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398749 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398664    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.398749 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.398728    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.400884 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.400857    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.401001 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.400897    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.405530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.405508    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.405726 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.405710    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qttfl\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl\") pod \"e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") " pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.460137 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.460100    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:09.735263 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.735228    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:18:09.737927 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:18:09.737900    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc341dcc9_c4b4_45d1_a60e_c67c76b4e982.slice/crio-b4a4ba11d58cd44a105e59f6efa121fdf22858c5590e03a6c996d17e8556c02b WatchSource:0}: Error finding container b4a4ba11d58cd44a105e59f6efa121fdf22858c5590e03a6c996d17e8556c02b: Status 404 returned error can't find the container with id b4a4ba11d58cd44a105e59f6efa121fdf22858c5590e03a6c996d17e8556c02b
Sep 11 19:18:09.740154 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.740122    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:09.740226 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.740191    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:09.740226 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:09.740217    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:10.091047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:10.090945    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerStarted","Data":"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"}
Sep 11 19:18:10.091047 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:10.091010    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerStarted","Data":"b4a4ba11d58cd44a105e59f6efa121fdf22858c5590e03a6c996d17e8556c02b"}
Sep 11 19:18:10.109092 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:10.109036    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podStartSLOduration=1.109019089 podStartE2EDuration="1.109019089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:10.107927055 +0000 UTC m=+1768.594850949" watchObservedRunningTime="2026-09-11 19:18:10.109019089 +0000 UTC m=+1768.595942967"
Sep 11 19:18:10.461184 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:10.461146    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:10.466421 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:10.466392    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:11.100013 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:11.099981    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:11.101127 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:11.101103    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:11.911617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:11.911556    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:18:13.737239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.737200    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:18:13.740901 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.740873    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.742954 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.742933    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-021613-serving-cert\""
Sep 11 19:18:13.751217 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.751190    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:18:13.845739 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.845702    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.846076 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.846054    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.846248 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.846232    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.846444 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.846427    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdqgx\" (UniqueName: \"kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.948068 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.948035    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.948068 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.948070    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.948316 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.948089    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.948316 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.948133    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdqgx\" (UniqueName: \"kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.948316 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:18:13.948225    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-serving-cert: secret "maas-api-e2e-ipp-a-021613-serving-cert" not found
Sep 11 19:18:13.948316 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:18:13.948296    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls podName:a58380bc-d86f-4efb-a0b5-5b401646e75b nodeName:}" failed. No retries permitted until 2026-09-11 19:18:14.448276333 +0000 UTC m=+1772.935200189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls") pod "maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" (UID: "a58380bc-d86f-4efb-a0b5-5b401646e75b") : secret "maas-api-e2e-ipp-a-021613-serving-cert" not found
Sep 11 19:18:13.948815 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.948794    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.950574 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.950552    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:13.959057 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:13.959033    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdqgx\" (UniqueName: \"kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:14.455118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:14.455076    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:14.457951 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:14.457923    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:14.654758 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:14.654724    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:14.926863 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:14.926835    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:18:14.928055 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:18:14.928033    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58380bc_d86f_4efb_a0b5_5b401646e75b.slice/crio-d54aa6de2c4a0333b2aa83e7ac2e1f5f23aa65bb4424377ff6057d5bf8650c5d WatchSource:0}: Error finding container d54aa6de2c4a0333b2aa83e7ac2e1f5f23aa65bb4424377ff6057d5bf8650c5d: Status 404 returned error can't find the container with id d54aa6de2c4a0333b2aa83e7ac2e1f5f23aa65bb4424377ff6057d5bf8650c5d
Sep 11 19:18:14.929424 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:14.929405    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:18:15.124172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:15.124084    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" event={"ID":"a58380bc-d86f-4efb-a0b5-5b401646e75b","Type":"ContainerStarted","Data":"d54aa6de2c4a0333b2aa83e7ac2e1f5f23aa65bb4424377ff6057d5bf8650c5d"}
Sep 11 19:18:16.131898 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:16.131861    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" event={"ID":"a58380bc-d86f-4efb-a0b5-5b401646e75b","Type":"ContainerStarted","Data":"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"}
Sep 11 19:18:16.132311 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:16.131968    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:16.148965 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:16.148906    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" podStartSLOduration=2.719246844 podStartE2EDuration="3.148890193s" totalImagesPullingTime="429.643349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:16.147072803 +0000 UTC m=+1774.633996684" watchObservedRunningTime="2026-09-11 19:18:16.148890193 +0000 UTC m=+1774.635814072"
Sep 11 19:18:22.143528 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:22.143495    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:18:25.528186 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:25.528144    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:18:30.227354 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.227321    2587 generic.go:356] "Generic (PLEG): container finished" podID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerID="8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b" exitCode=0
Sep 11 19:18:30.227875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.227404    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerDied","Data":"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"}
Sep 11 19:18:30.227973 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.227955    2587 scope.go:117] "RemoveContainer" containerID="8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"
Sep 11 19:18:30.229110 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.229081    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:30.229174 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.229153    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:30.229214 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:30.229182    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:18:31.236021 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:31.235987    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerStarted","Data":"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"}
Sep 11 19:18:31.461193 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:31.461149    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:31.461419 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:31.461394    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 11 19:18:31.461507 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:31.461456    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 11 19:18:32.460975 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:32.460934    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 11 19:18:32.461389 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:32.460998    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 11 19:18:33.461292 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:33.461245    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 11 19:18:33.461818 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:33.461316    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 11 19:18:34.460915 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:34.460822    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 11 19:18:34.460915 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:34.460888    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 11 19:18:35.460777 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:35.460738    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Sep 11 19:18:35.461258 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:35.460797    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Sep 11 19:18:36.490280 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:36.490241    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:36.490787 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:36.490638    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:36.491529 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:36.491510    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:18:43.552568 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.552530    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:18:43.557034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.557005    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.559113 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.559085    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-afd85c-serving-cert\""
Sep 11 19:18:43.568584 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.568553    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:18:43.648555 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.648519    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.648762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.648561    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2dl\" (UniqueName: \"kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.648762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.648676    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.648762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.648730    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.749733 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.749699    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.749733 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.749737    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2dl\" (UniqueName: \"kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.750013 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.749777    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.750013 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.749824    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.750013 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:18:43.749944    2587 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-serving-cert: secret "maas-api-e2e-ipp-b-afd85c-serving-cert" not found
Sep 11 19:18:43.750013 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:18:43.750004    2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls podName:36bc490a-b3e7-421e-b415-43bf7922fba9 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:44.249986614 +0000 UTC m=+1802.736910473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls") pod "maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" (UID: "36bc490a-b3e7-421e-b415-43bf7922fba9") : secret "maas-api-e2e-ipp-b-afd85c-serving-cert" not found
Sep 11 19:18:43.750423 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.750397    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.752300 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.752278    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:43.760964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:43.760933    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2dl\" (UniqueName: \"kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:44.254163 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:44.254119    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:44.256877 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:44.256841    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:44.471817 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:44.471782    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:44.750606 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:44.750557    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:18:44.751326 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:18:44.751302    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bc490a_b3e7_421e_b415_43bf7922fba9.slice/crio-d39f14e5cc294e1b740a0d535441b8886211c5aadc510e2227f76d84c50d9098 WatchSource:0}: Error finding container d39f14e5cc294e1b740a0d535441b8886211c5aadc510e2227f76d84c50d9098: Status 404 returned error can't find the container with id d39f14e5cc294e1b740a0d535441b8886211c5aadc510e2227f76d84c50d9098
Sep 11 19:18:45.327826 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:45.327786    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" event={"ID":"36bc490a-b3e7-421e-b415-43bf7922fba9","Type":"ContainerStarted","Data":"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"}
Sep 11 19:18:45.327999 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:45.327854    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" event={"ID":"36bc490a-b3e7-421e-b415-43bf7922fba9","Type":"ContainerStarted","Data":"d39f14e5cc294e1b740a0d535441b8886211c5aadc510e2227f76d84c50d9098"}
Sep 11 19:18:45.327999 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:45.327886    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:18:45.344024 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:45.343964    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" podStartSLOduration=2.000948142 podStartE2EDuration="2.343947982s" totalImagesPullingTime="342.99984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:45.341971283 +0000 UTC m=+1803.828895163" watchObservedRunningTime="2026-09-11 19:18:45.343947982 +0000 UTC m=+1803.830871861"
Sep 11 19:18:48.713403 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:48.713354    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:18:51.339850 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:18:51.339821    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:19:28.116038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:28.115994    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:19:40.718339 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:40.718301    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:19:47.774150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.774112    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:19:47.777940 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.777918    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.779960 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.779938    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-75b1ed-openshift-default-dockercfg-8xwzw\""
Sep 11 19:19:47.789653 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.789627    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:19:47.879383 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879348    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879608 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879417    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879608 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879486    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879608 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879526    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879608 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879559    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlmxp\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879608 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879579    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879893 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879626    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879893 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879673    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.879893 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.879704    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980375 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980335    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980543 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980393    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlmxp\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980588 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980571    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980672 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980645    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980717 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980697    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980772 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980732    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980782    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980791    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980935 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980873    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.980991 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.980937    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.981042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.981006    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.981223 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.981168    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.981319 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.981241    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.981400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.981383    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.982876 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.982856    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.983108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.983089    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.988463 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.988434    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:47.988662 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:47.988643    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlmxp\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp\") pod \"e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") " pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:48.089825 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.089732    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:48.379916 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.379888    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:19:48.382007 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:19:48.381981    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1c15a3_3379_4f8c_9843_9649b923942c.slice/crio-5e54673e833a7aaabe169184d0d418648d96c4a12e60c802ed16174ce4e1fd5b WatchSource:0}: Error finding container 5e54673e833a7aaabe169184d0d418648d96c4a12e60c802ed16174ce4e1fd5b: Status 404 returned error can't find the container with id 5e54673e833a7aaabe169184d0d418648d96c4a12e60c802ed16174ce4e1fd5b
Sep 11 19:19:48.384762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.384729    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:19:48.384874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.384797    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:19:48.384874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.384829    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:19:48.714566 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.714522    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerStarted","Data":"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"}
Sep 11 19:19:48.714756 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.714632    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerStarted","Data":"5e54673e833a7aaabe169184d0d418648d96c4a12e60c802ed16174ce4e1fd5b"}
Sep 11 19:19:48.736435 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:48.736374    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podStartSLOduration=1.736356679 podStartE2EDuration="1.736356679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:48.733540169 +0000 UTC m=+1867.220464044" watchObservedRunningTime="2026-09-11 19:19:48.736356679 +0000 UTC m=+1867.223280560"
Sep 11 19:19:49.091010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:49.090911    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:49.096436 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:49.096402    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:49.720700 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:49.720669    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:49.721716 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:49.721689    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:19:59.104932 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:19:59.104890    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:20:08.851185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.851078    2587 generic.go:356] "Generic (PLEG): container finished" podID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerID="a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c" exitCode=0
Sep 11 19:20:08.851185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.851158    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerDied","Data":"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"}
Sep 11 19:20:08.851719 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.851639    2587 scope.go:117] "RemoveContainer" containerID="a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"
Sep 11 19:20:08.852864 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.852834    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:20:08.852964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.852901    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:20:08.852964 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:08.852934    2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236196Ki","pods":"250"}
Sep 11 19:20:09.859268 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:09.859227    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerStarted","Data":"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"}
Sep 11 19:20:10.091181 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:10.091141    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:10.091584 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:10.091500    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:10.091799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:10.091776    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:11.091178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:11.090682    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:11.091178 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:11.090752    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:12.091291 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:12.091239    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:12.091909 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:12.091874    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:13.090869 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:13.090818    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:13.091096 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:13.090894    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:14.097079 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:14.097033    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:14.097583 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:14.097114    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:15.091050 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:15.091008    2587 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 11 19:20:15.091232 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:15.091104    2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 11 19:20:16.095933 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:16.095897    2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:16.096413 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:16.096192    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:16.097327 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:16.097303    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:37.503695 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:37.503655    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:20:39.026516 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:39.026478    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:20:39.027039 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:39.026718    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy" containerID="cri-o://fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829" gracePeriod=30
Sep 11 19:20:44.284848 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.284812    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:44.365984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.365893    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.365984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.365941    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.365984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.365967    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.365984 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.365986    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366034    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366064    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366120    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlmxp\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366150    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366224    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo\") pod \"ef1c15a3-3379-4f8c-9843-9649b923942c\" (UID: \"ef1c15a3-3379-4f8c-9843-9649b923942c\") "
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366269    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:44.366321 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366305    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:44.366721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366367    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:44.366721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366578    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:44.366721 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366639    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:20:44.366874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366725    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.366874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366746    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.366874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366760    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.366874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.366772    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.368904 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.368838    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:20:44.368904 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.368877    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:20:44.369111 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.369000    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp" (OuterVolumeSpecName: "kube-api-access-tlmxp") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "kube-api-access-tlmxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:20:44.369354 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.369329    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef1c15a3-3379-4f8c-9843-9649b923942c" (UID: "ef1c15a3-3379-4f8c-9843-9649b923942c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:20:44.467980 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.467935    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlmxp\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-kube-api-access-tlmxp\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.467980 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.467973    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.467980 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.467986    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.468242 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.467998    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef1c15a3-3379-4f8c-9843-9649b923942c-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:44.468242 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:44.468009    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef1c15a3-3379-4f8c-9843-9649b923942c-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:45.095030 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.094992    2587 generic.go:356] "Generic (PLEG): container finished" podID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerID="fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829" exitCode=0
Sep 11 19:20:45.095241 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.095064    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"
Sep 11 19:20:45.095241 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.095072    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerDied","Data":"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"}
Sep 11 19:20:45.095241 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.095130    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8" event={"ID":"ef1c15a3-3379-4f8c-9843-9649b923942c","Type":"ContainerDied","Data":"5e54673e833a7aaabe169184d0d418648d96c4a12e60c802ed16174ce4e1fd5b"}
Sep 11 19:20:45.095241 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.095155    2587 scope.go:117] "RemoveContainer" containerID="fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"
Sep 11 19:20:45.105739 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.105715    2587 scope.go:117] "RemoveContainer" containerID="a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"
Sep 11 19:20:45.115293 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.115267    2587 scope.go:117] "RemoveContainer" containerID="fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"
Sep 11 19:20:45.115934 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:20:45.115901    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829\": container with ID starting with fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829 not found: ID does not exist" containerID="fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"
Sep 11 19:20:45.116043 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.115944    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829"} err="failed to get container status \"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829\": rpc error: code = NotFound desc = could not find container \"fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829\": container with ID starting with fda446b054bae3c0c2053abbe5f050107206946ef00f8276ec7cc9dd6c511829 not found: ID does not exist"
Sep 11 19:20:45.116043 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.115972    2587 scope.go:117] "RemoveContainer" containerID="a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"
Sep 11 19:20:45.116307 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:20:45.116282    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c\": container with ID starting with a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c not found: ID does not exist" containerID="a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"
Sep 11 19:20:45.116398 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.116312    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c"} err="failed to get container status \"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c\": rpc error: code = NotFound desc = could not find container \"a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c\": container with ID starting with a4093352a5359435eff2616c645e844f3c307042b19e0747ecdef1eb2256346c not found: ID does not exist"
Sep 11 19:20:45.119057 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.119030    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:20:45.121830 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.121806    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75b1ed-openshift-default-6cf898df96-94kp8"]
Sep 11 19:20:45.997086 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:45.997050    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" path="/var/lib/kubelet/pods/ef1c15a3-3379-4f8c-9843-9649b923942c/volumes"
Sep 11 19:20:55.818687 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:55.818648    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:20:58.134723 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.134678    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:20:58.135177 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.135003    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" podUID="a58380bc-d86f-4efb-a0b5-5b401646e75b" containerName="maas-api" containerID="cri-o://6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b" gracePeriod=30
Sep 11 19:20:58.405790 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.405760    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:20:58.504881 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.504836    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") pod \"a58380bc-d86f-4efb-a0b5-5b401646e75b\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") "
Sep 11 19:20:58.505086 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.504913    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdqgx\" (UniqueName: \"kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx\") pod \"a58380bc-d86f-4efb-a0b5-5b401646e75b\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") "
Sep 11 19:20:58.505086 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.504936    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca\") pod \"a58380bc-d86f-4efb-a0b5-5b401646e75b\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") "
Sep 11 19:20:58.505086 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.505008    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs\") pod \"a58380bc-d86f-4efb-a0b5-5b401646e75b\" (UID: \"a58380bc-d86f-4efb-a0b5-5b401646e75b\") "
Sep 11 19:20:58.505447 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.505418    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a58380bc-d86f-4efb-a0b5-5b401646e75b" (UID: "a58380bc-d86f-4efb-a0b5-5b401646e75b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:20:58.507508 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.507473    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx" (OuterVolumeSpecName: "kube-api-access-pdqgx") pod "a58380bc-d86f-4efb-a0b5-5b401646e75b" (UID: "a58380bc-d86f-4efb-a0b5-5b401646e75b"). InnerVolumeSpecName "kube-api-access-pdqgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:20:58.507711 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.507627    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a58380bc-d86f-4efb-a0b5-5b401646e75b" (UID: "a58380bc-d86f-4efb-a0b5-5b401646e75b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:58.507711 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.507655    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a58380bc-d86f-4efb-a0b5-5b401646e75b" (UID: "a58380bc-d86f-4efb-a0b5-5b401646e75b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:20:58.605979 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.605944    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:58.605979 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.605973    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58380bc-d86f-4efb-a0b5-5b401646e75b-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:58.605979 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.605983    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdqgx\" (UniqueName: \"kubernetes.io/projected/a58380bc-d86f-4efb-a0b5-5b401646e75b-kube-api-access-pdqgx\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:58.606224 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:58.605994    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58380bc-d86f-4efb-a0b5-5b401646e75b-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:20:59.184215 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.184181    2587 generic.go:356] "Generic (PLEG): container finished" podID="a58380bc-d86f-4efb-a0b5-5b401646e75b" containerID="6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b" exitCode=0
Sep 11 19:20:59.184686 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.184234    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" event={"ID":"a58380bc-d86f-4efb-a0b5-5b401646e75b","Type":"ContainerDied","Data":"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"}
Sep 11 19:20:59.184686 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.184242    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"
Sep 11 19:20:59.184686 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.184303    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm" event={"ID":"a58380bc-d86f-4efb-a0b5-5b401646e75b","Type":"ContainerDied","Data":"d54aa6de2c4a0333b2aa83e7ac2e1f5f23aa65bb4424377ff6057d5bf8650c5d"}
Sep 11 19:20:59.184686 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.184324    2587 scope.go:117] "RemoveContainer" containerID="6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"
Sep 11 19:20:59.195044 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.195015    2587 scope.go:117] "RemoveContainer" containerID="6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"
Sep 11 19:20:59.195399 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:20:59.195377    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b\": container with ID starting with 6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b not found: ID does not exist" containerID="6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"
Sep 11 19:20:59.195470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.195410    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b"} err="failed to get container status \"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b\": rpc error: code = NotFound desc = could not find container \"6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b\": container with ID starting with 6e3f88e44b2d8f3733441e2164c7bed88f9dc255a1a7113866dcc899b73a799b not found: ID does not exist"
Sep 11 19:20:59.212492 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.211472    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:20:59.216658 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.216620    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-021613-6c46f9d95c-jjfjm"]
Sep 11 19:20:59.996877 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:20:59.996838    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a58380bc-d86f-4efb-a0b5-5b401646e75b" path="/var/lib/kubelet/pods/a58380bc-d86f-4efb-a0b5-5b401646e75b/volumes"
Sep 11 19:21:08.710355 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:08.710316    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:21:46.638049 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:46.638010    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:21:46.638470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:46.638287    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" containerID="cri-o://21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc" gracePeriod=30
Sep 11 19:21:51.493096 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:51.493056    2587 patch_prober.go:28] interesting pod/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:21:51.493652 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:51.493120    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:21:51.896342 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:51.896312    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:21:52.038449 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038345    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038449 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038393    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038449 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038428    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038540    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038588    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038679    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038708    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038725    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038741    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:21:52.038799 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038762    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qttfl\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl\") pod \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\" (UID: \"c341dcc9-c4b4-45d1-a60e-c67c76b4e982\") "
Sep 11 19:21:52.039167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.038900    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:52.039167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039006    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:21:52.039167 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039130    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data" (OuterVolumeSpecName: "istio-data") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:21:52.039332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039187    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:21:52.039332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039266    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.039332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039295    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.039332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039312    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.039332 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.039325    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.040880 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.040856    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:21:52.041035 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.041010    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token" (OuterVolumeSpecName: "istio-token") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:21:52.041316 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.041286    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:21:52.041316 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.041294    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl" (OuterVolumeSpecName: "kube-api-access-qttfl") pod "c341dcc9-c4b4-45d1-a60e-c67c76b4e982" (UID: "c341dcc9-c4b4-45d1-a60e-c67c76b4e982"). InnerVolumeSpecName "kube-api-access-qttfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:21:52.140977 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.140933    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.140977 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.140977    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.141244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.140994    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.141244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.141006    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.141244 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.141022    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qttfl\" (UniqueName: \"kubernetes.io/projected/c341dcc9-c4b4-45d1-a60e-c67c76b4e982-kube-api-access-qttfl\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:52.498673 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.498633    2587 generic.go:356] "Generic (PLEG): container finished" podID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerID="21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc" exitCode=0
Sep 11 19:21:52.499120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.498681    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"
Sep 11 19:21:52.499120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.498713    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerDied","Data":"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"}
Sep 11 19:21:52.499120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.498764    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq" event={"ID":"c341dcc9-c4b4-45d1-a60e-c67c76b4e982","Type":"ContainerDied","Data":"b4a4ba11d58cd44a105e59f6efa121fdf22858c5590e03a6c996d17e8556c02b"}
Sep 11 19:21:52.499120 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.498787    2587 scope.go:117] "RemoveContainer" containerID="21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"
Sep 11 19:21:52.509001 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.508978    2587 scope.go:117] "RemoveContainer" containerID="8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"
Sep 11 19:21:52.518474 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.518448    2587 scope.go:117] "RemoveContainer" containerID="21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"
Sep 11 19:21:52.518852 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:21:52.518831    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc\": container with ID starting with 21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc not found: ID does not exist" containerID="21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"
Sep 11 19:21:52.518924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.518862    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc"} err="failed to get container status \"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc\": rpc error: code = NotFound desc = could not find container \"21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc\": container with ID starting with 21d525fd0396ab59615c5a00fa3fbb0b94cab340f2f8ac62fa925af5fe01a8fc not found: ID does not exist"
Sep 11 19:21:52.518924 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.518879    2587 scope.go:117] "RemoveContainer" containerID="8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"
Sep 11 19:21:52.519171 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:21:52.519152    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b\": container with ID starting with 8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b not found: ID does not exist" containerID="8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"
Sep 11 19:21:52.519222 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.519178    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b"} err="failed to get container status \"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b\": rpc error: code = NotFound desc = could not find container \"8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b\": container with ID starting with 8c8e69d0e56b2be9e2ac17be70e042540114063dcd631332ca8eb9f78a63805b not found: ID does not exist"
Sep 11 19:21:52.520668 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.520637    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:21:52.530250 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:52.527226    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-021613-openshift-default-768fc4f4bd-wtqfq"]
Sep 11 19:21:53.996607 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:53.996557    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" path="/var/lib/kubelet/pods/c341dcc9-c4b4-45d1-a60e-c67c76b4e982/volumes"
Sep 11 19:21:57.487626 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.487573    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:21:57.488103 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.487871    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" podUID="36bc490a-b3e7-421e-b415-43bf7922fba9" containerName="maas-api" containerID="cri-o://1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771" gracePeriod=30
Sep 11 19:21:57.750518 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.750451    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:21:57.896118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.896076    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") pod \"36bc490a-b3e7-421e-b415-43bf7922fba9\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") "
Sep 11 19:21:57.896302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.896174    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca\") pod \"36bc490a-b3e7-421e-b415-43bf7922fba9\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") "
Sep 11 19:21:57.896302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.896198    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs\") pod \"36bc490a-b3e7-421e-b415-43bf7922fba9\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") "
Sep 11 19:21:57.896302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.896234    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x2dl\" (UniqueName: \"kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl\") pod \"36bc490a-b3e7-421e-b415-43bf7922fba9\" (UID: \"36bc490a-b3e7-421e-b415-43bf7922fba9\") "
Sep 11 19:21:57.896983 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.896949    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36bc490a-b3e7-421e-b415-43bf7922fba9" (UID: "36bc490a-b3e7-421e-b415-43bf7922fba9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:21:57.898644 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.898578    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36bc490a-b3e7-421e-b415-43bf7922fba9" (UID: "36bc490a-b3e7-421e-b415-43bf7922fba9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:21:57.898741 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.898717    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "36bc490a-b3e7-421e-b415-43bf7922fba9" (UID: "36bc490a-b3e7-421e-b415-43bf7922fba9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:21:57.899180 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.899154    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl" (OuterVolumeSpecName: "kube-api-access-2x2dl") pod "36bc490a-b3e7-421e-b415-43bf7922fba9" (UID: "36bc490a-b3e7-421e-b415-43bf7922fba9"). InnerVolumeSpecName "kube-api-access-2x2dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:21:57.997302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.997180    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bc490a-b3e7-421e-b415-43bf7922fba9-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:57.997302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.997212    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:57.997302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.997301    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x2dl\" (UniqueName: \"kubernetes.io/projected/36bc490a-b3e7-421e-b415-43bf7922fba9-kube-api-access-2x2dl\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:57.997302 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:57.997313    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bc490a-b3e7-421e-b415-43bf7922fba9-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:21:58.549617 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.549556    2587 generic.go:356] "Generic (PLEG): container finished" podID="36bc490a-b3e7-421e-b415-43bf7922fba9" containerID="1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771" exitCode=0
Sep 11 19:21:58.550034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.549626    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"
Sep 11 19:21:58.550034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.549647    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" event={"ID":"36bc490a-b3e7-421e-b415-43bf7922fba9","Type":"ContainerDied","Data":"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"}
Sep 11 19:21:58.550034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.549706    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw" event={"ID":"36bc490a-b3e7-421e-b415-43bf7922fba9","Type":"ContainerDied","Data":"d39f14e5cc294e1b740a0d535441b8886211c5aadc510e2227f76d84c50d9098"}
Sep 11 19:21:58.550034 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.549727    2587 scope.go:117] "RemoveContainer" containerID="1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"
Sep 11 19:21:58.559479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.559454    2587 scope.go:117] "RemoveContainer" containerID="1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"
Sep 11 19:21:58.559785 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:21:58.559763    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771\": container with ID starting with 1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771 not found: ID does not exist" containerID="1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"
Sep 11 19:21:58.559869 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.559793    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771"} err="failed to get container status \"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771\": rpc error: code = NotFound desc = could not find container \"1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771\": container with ID starting with 1660ee32025d9dbb4ab026d16326b43e66054dc286784336bfa3aac59e07a771 not found: ID does not exist"
Sep 11 19:21:58.566054 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.566030    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:21:58.568766 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:58.568744    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-afd85c-6b9b6c7746-brdhw"]
Sep 11 19:21:59.996584 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:21:59.996546    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bc490a-b3e7-421e-b415-43bf7922fba9" path="/var/lib/kubelet/pods/36bc490a-b3e7-421e-b415-43bf7922fba9/volumes"
Sep 11 19:22:01.009357 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:01.009321    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:22:18.421853 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:18.421813    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:22:23.237161 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:23.237124    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:22:23.237820 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:23.237362    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" containerID="cri-o://176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e" gracePeriod=30
Sep 11 19:22:27.569458 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:27.569411    2587 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:22:27.569895 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:27.569494    2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:22:28.514207 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.514143    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:22:28.567127 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567096    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567134    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567202    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567223    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567296    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckbvm\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567538 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567352    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567538 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567440    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:22:28.567538 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567440    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567538 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567509    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567564    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs\") pod \"1c53de57-b843-4e84-bc7d-15474e366789\" (UID: \"1c53de57-b843-4e84-bc7d-15474e366789\") "
Sep 11 19:22:28.567762 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567580    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:22:28.567885 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567794    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:22:28.567960 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567939    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:22:28.568014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.567986    2587 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.568014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.568004    2587 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-credential-socket\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.568124 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.568015    2587 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-data\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.568124 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.568032    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:28.569730 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.569701    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:22:28.570107 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.569997    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:22:28.570107 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.570081    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:22:28.570186 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.570114    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm" (OuterVolumeSpecName: "kube-api-access-ckbvm") pod "1c53de57-b843-4e84-bc7d-15474e366789" (UID: "1c53de57-b843-4e84-bc7d-15474e366789"). InnerVolumeSpecName "kube-api-access-ckbvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:22:28.668978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.668941    2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-istio-token\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.668978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.668973    2587 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c53de57-b843-4e84-bc7d-15474e366789-istiod-ca-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.668978 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.668984    2587 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-workload-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.669209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.668992    2587 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c53de57-b843-4e84-bc7d-15474e366789-istio-envoy\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.669209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.669000    2587 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c53de57-b843-4e84-bc7d-15474e366789-istio-podinfo\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.669209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.669008    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckbvm\" (UniqueName: \"kubernetes.io/projected/1c53de57-b843-4e84-bc7d-15474e366789-kube-api-access-ckbvm\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:28.731602 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.731556    2587 generic.go:356] "Generic (PLEG): container finished" podID="1c53de57-b843-4e84-bc7d-15474e366789" containerID="176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e" exitCode=0
Sep 11 19:22:28.731763 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.731615    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"
Sep 11 19:22:28.731763 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.731634    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerDied","Data":"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"}
Sep 11 19:22:28.731763 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.731712    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl" event={"ID":"1c53de57-b843-4e84-bc7d-15474e366789","Type":"ContainerDied","Data":"dc643a42091bbc8408a0338ad4122aefa797598230a83ea47d4677d18a124643"}
Sep 11 19:22:28.731763 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.731737    2587 scope.go:117] "RemoveContainer" containerID="176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"
Sep 11 19:22:28.741742 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.741723    2587 scope.go:117] "RemoveContainer" containerID="3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"
Sep 11 19:22:28.750390 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.750371    2587 scope.go:117] "RemoveContainer" containerID="176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"
Sep 11 19:22:28.750697 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:22:28.750678    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e\": container with ID starting with 176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e not found: ID does not exist" containerID="176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"
Sep 11 19:22:28.750753 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.750708    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e"} err="failed to get container status \"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e\": rpc error: code = NotFound desc = could not find container \"176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e\": container with ID starting with 176a46163dd758a92f8a1b901e328cd43352ab78e46eb4c5ee9ab6e21206632e not found: ID does not exist"
Sep 11 19:22:28.750753 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.750726    2587 scope.go:117] "RemoveContainer" containerID="3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"
Sep 11 19:22:28.750975 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:22:28.750960    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578\": container with ID starting with 3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578 not found: ID does not exist" containerID="3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"
Sep 11 19:22:28.751014 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.750982    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578"} err="failed to get container status \"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578\": rpc error: code = NotFound desc = could not find container \"3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578\": container with ID starting with 3e3683bc881d3e65b418a19ac431e165b24cea5dfc19ab7a1aea9b8294b91578 not found: ID does not exist"
Sep 11 19:22:28.755209 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.755184    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:22:28.759401 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:28.759379    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8280eb-openshift-default-5566668bcd-bvqcl"]
Sep 11 19:22:29.996199 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:29.996166    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c53de57-b843-4e84-bc7d-15474e366789" path="/var/lib/kubelet/pods/1c53de57-b843-4e84-bc7d-15474e366789/volumes"
Sep 11 19:22:34.189073 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.189035    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:22:34.189561 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.189305    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" podUID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" containerName="maas-api" containerID="cri-o://fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475" gracePeriod=30
Sep 11 19:22:34.455646 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.455572    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:22:34.518914 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.518882    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs\") pod \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") "
Sep 11 19:22:34.519117 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.518939    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb7bk\" (UniqueName: \"kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk\") pod \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") "
Sep 11 19:22:34.519117 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.518971    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") pod \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") "
Sep 11 19:22:34.519117 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.519036    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca\") pod \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\" (UID: \"5dd87a03-1fb2-4bfd-aa13-c7abcc208408\") "
Sep 11 19:22:34.519568 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.519523    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5dd87a03-1fb2-4bfd-aa13-c7abcc208408" (UID: "5dd87a03-1fb2-4bfd-aa13-c7abcc208408"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:22:34.521229 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.521202    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5dd87a03-1fb2-4bfd-aa13-c7abcc208408" (UID: "5dd87a03-1fb2-4bfd-aa13-c7abcc208408"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:34.521329 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.521260    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5dd87a03-1fb2-4bfd-aa13-c7abcc208408" (UID: "5dd87a03-1fb2-4bfd-aa13-c7abcc208408"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:34.521609 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.521582    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk" (OuterVolumeSpecName: "kube-api-access-sb7bk") pod "5dd87a03-1fb2-4bfd-aa13-c7abcc208408" (UID: "5dd87a03-1fb2-4bfd-aa13-c7abcc208408"). InnerVolumeSpecName "kube-api-access-sb7bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:22:34.619842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.619807    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:34.619842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.619835    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:34.619842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.619844    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb7bk\" (UniqueName: \"kubernetes.io/projected/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-kube-api-access-sb7bk\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:34.620073 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.619854    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd87a03-1fb2-4bfd-aa13-c7abcc208408-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:34.772172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.772079    2587 generic.go:356] "Generic (PLEG): container finished" podID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" containerID="fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475" exitCode=0
Sep 11 19:22:34.772172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.772125    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"
Sep 11 19:22:34.772374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.772164    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" event={"ID":"5dd87a03-1fb2-4bfd-aa13-c7abcc208408","Type":"ContainerDied","Data":"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"}
Sep 11 19:22:34.772374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.772223    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj" event={"ID":"5dd87a03-1fb2-4bfd-aa13-c7abcc208408","Type":"ContainerDied","Data":"f1c4a85cdbbdd484256b9776eaa5baa297e00131ba5e01bff2864374f69bc1bb"}
Sep 11 19:22:34.772374 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.772252    2587 scope.go:117] "RemoveContainer" containerID="fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"
Sep 11 19:22:34.784065 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.784041    2587 scope.go:117] "RemoveContainer" containerID="fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"
Sep 11 19:22:34.784397 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:22:34.784371    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475\": container with ID starting with fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475 not found: ID does not exist" containerID="fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"
Sep 11 19:22:34.784505 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.784411    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475"} err="failed to get container status \"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475\": rpc error: code = NotFound desc = could not find container \"fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475\": container with ID starting with fbd5ade37d556fe4576953b438ed4735ee152b3deefa676645d92555bcc24475 not found: ID does not exist"
Sep 11 19:22:34.803356 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.803323    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:22:34.807010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:34.806983    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b7391-5788c97cbc-w7kdj"]
Sep 11 19:22:35.996445 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:35.996403    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" path="/var/lib/kubelet/pods/5dd87a03-1fb2-4bfd-aa13-c7abcc208408/volumes"
Sep 11 19:22:36.819895 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:36.819858    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:22:44.769451 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:44.769412    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 19:22:44.769874 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:44.769655    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-674ff667f9-7hk52" podUID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" containerName="manager" containerID="cri-o://b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f" gracePeriod=30
Sep 11 19:22:45.024630 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.024552    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 19:22:45.119756 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.119718    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs\") pod \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") "
Sep 11 19:22:45.119935 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.119826    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-978mv\" (UniqueName: \"kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv\") pod \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") "
Sep 11 19:22:45.119935 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.119861    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") pod \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\" (UID: \"23efbbdd-c937-47c0-8b07-4d81a1a003fc\") "
Sep 11 19:22:45.121899 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.121867    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23efbbdd-c937-47c0-8b07-4d81a1a003fc" (UID: "23efbbdd-c937-47c0-8b07-4d81a1a003fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:45.121899 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.121884    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv" (OuterVolumeSpecName: "kube-api-access-978mv") pod "23efbbdd-c937-47c0-8b07-4d81a1a003fc" (UID: "23efbbdd-c937-47c0-8b07-4d81a1a003fc"). InnerVolumeSpecName "kube-api-access-978mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:22:45.121899 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.121893    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23efbbdd-c937-47c0-8b07-4d81a1a003fc" (UID: "23efbbdd-c937-47c0-8b07-4d81a1a003fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:22:45.221030 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.220998    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978mv\" (UniqueName: \"kubernetes.io/projected/23efbbdd-c937-47c0-8b07-4d81a1a003fc-kube-api-access-978mv\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:45.221030 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.221027    2587 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-webhook-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:45.221030 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.221036    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23efbbdd-c937-47c0-8b07-4d81a1a003fc-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:22:45.837816 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.837784    2587 generic.go:356] "Generic (PLEG): container finished" podID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" containerID="b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f" exitCode=0
Sep 11 19:22:45.838203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.837878    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7hk52"
Sep 11 19:22:45.838203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.837909    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7hk52" event={"ID":"23efbbdd-c937-47c0-8b07-4d81a1a003fc","Type":"ContainerDied","Data":"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"}
Sep 11 19:22:45.838203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.837956    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7hk52" event={"ID":"23efbbdd-c937-47c0-8b07-4d81a1a003fc","Type":"ContainerDied","Data":"4c4f6faf9bd4a54fa3be689506f9c7c1d14a904843b1e01e691f3099716e3635"}
Sep 11 19:22:45.838203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.837982    2587 scope.go:117] "RemoveContainer" containerID="b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"
Sep 11 19:22:45.858838 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.858804    2587 scope.go:117] "RemoveContainer" containerID="b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"
Sep 11 19:22:45.859335 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:22:45.859301    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f\": container with ID starting with b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f not found: ID does not exist" containerID="b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"
Sep 11 19:22:45.859452 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.859355    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f"} err="failed to get container status \"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f\": rpc error: code = NotFound desc = could not find container \"b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f\": container with ID starting with b11d5a2126412aac7a0320e1869c1c403965832bec194efe982cf666ce285d2f not found: ID does not exist"
Sep 11 19:22:45.870151 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.870122    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 19:22:45.874285 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.874256    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7hk52"]
Sep 11 19:22:45.995941 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:45.995905    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" path="/var/lib/kubelet/pods/23efbbdd-c937-47c0-8b07-4d81a1a003fc/volumes"
Sep 11 19:22:46.107042 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:22:46.106960    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:23:46.674033 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.673997    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:23:46.674443 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674406    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bc490a-b3e7-421e-b415-43bf7922fba9" containerName="maas-api"
Sep 11 19:23:46.674443 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674417    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bc490a-b3e7-421e-b415-43bf7922fba9" containerName="maas-api"
Sep 11 19:23:46.674443 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674434    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.674443 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674439    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674447    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674452    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674458    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" containerName="maas-api"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674463    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" containerName="maas-api"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674470    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a58380bc-d86f-4efb-a0b5-5b401646e75b" containerName="maas-api"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674475    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a58380bc-d86f-4efb-a0b5-5b401646e75b" containerName="maas-api"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674482    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674487    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674494    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674499    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674508    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674514    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674520    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674526    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674533    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" containerName="manager"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674538    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" containerName="manager"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674604    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bc490a-b3e7-421e-b415-43bf7922fba9" containerName="maas-api"
Sep 11 19:23:46.674586 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674611    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674617    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674623    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674629    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd87a03-1fb2-4bfd-aa13-c7abcc208408" containerName="maas-api"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674635    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="23efbbdd-c937-47c0-8b07-4d81a1a003fc" containerName="manager"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674641    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="c341dcc9-c4b4-45d1-a60e-c67c76b4e982" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674646    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1c15a3-3379-4f8c-9843-9649b923942c" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674653    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c53de57-b843-4e84-bc7d-15474e366789" containerName="istio-proxy"
Sep 11 19:23:46.675136 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.674657    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a58380bc-d86f-4efb-a0b5-5b401646e75b" containerName="maas-api"
Sep 11 19:23:46.677697 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.677681    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.680426 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.680400    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 19:23:46.680426 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.680411    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mtdfh\""
Sep 11 19:23:46.680663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.680486    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 19:23:46.680663 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.680505    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 19:23:46.687465 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.687438    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:23:46.798690 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.798654    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2bx\" (UniqueName: \"kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.798888 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.798734    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.798888 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.798821    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.900206 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.900164    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.900395 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.900212    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2bx\" (UniqueName: \"kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.900395 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.900282    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.902801 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.902776    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.902903 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.902833    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.907426 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.907401    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2bx\" (UniqueName: \"kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx\") pod \"maas-controller-674ff667f9-86sgl\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") " pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:46.989467 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:46.989378    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:47.262035 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:47.262009    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:23:47.263437 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:23:47.263416    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97686b7_0615_410f_b699_28d690866473.slice/crio-4a74238044d0fd79556145d81f4df472e279835053a81b756baf1bc8e295e6a8 WatchSource:0}: Error finding container 4a74238044d0fd79556145d81f4df472e279835053a81b756baf1bc8e295e6a8: Status 404 returned error can't find the container with id 4a74238044d0fd79556145d81f4df472e279835053a81b756baf1bc8e295e6a8
Sep 11 19:23:47.264845 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:47.264827    2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:23:48.189880 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:48.189840    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-86sgl" event={"ID":"e97686b7-0615-410f-b699-28d690866473","Type":"ContainerStarted","Data":"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"}
Sep 11 19:23:48.190279 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:48.189901    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-86sgl" event={"ID":"e97686b7-0615-410f-b699-28d690866473","Type":"ContainerStarted","Data":"4a74238044d0fd79556145d81f4df472e279835053a81b756baf1bc8e295e6a8"}
Sep 11 19:23:48.190279 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:48.189930    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:23:48.209380 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:48.209322    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-674ff667f9-86sgl" podStartSLOduration=1.679615707 podStartE2EDuration="2.20930737s" totalImagesPullingTime="529.691663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:23:48.207018965 +0000 UTC m=+2106.693942845" watchObservedRunningTime="2026-09-11 19:23:48.20930737 +0000 UTC m=+2106.696231248"
Sep 11 19:23:59.199090 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:23:59.199054    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:24:08.013085 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.013053    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:24:08.498660 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.498620    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:24:08.498926 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.498876    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-674ff667f9-86sgl" podUID="e97686b7-0615-410f-b699-28d690866473" containerName="manager" containerID="cri-o://1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095" gracePeriod=30
Sep 11 19:24:08.773002 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.772973    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:24:08.905981 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.905943    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert\") pod \"e97686b7-0615-410f-b699-28d690866473\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") "
Sep 11 19:24:08.906156 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.905991    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs\") pod \"e97686b7-0615-410f-b699-28d690866473\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") "
Sep 11 19:24:08.906156 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.906017    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf2bx\" (UniqueName: \"kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx\") pod \"e97686b7-0615-410f-b699-28d690866473\" (UID: \"e97686b7-0615-410f-b699-28d690866473\") "
Sep 11 19:24:08.908311 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.908282    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e97686b7-0615-410f-b699-28d690866473" (UID: "e97686b7-0615-410f-b699-28d690866473"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:24:08.908311 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.908296    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx" (OuterVolumeSpecName: "kube-api-access-vf2bx") pod "e97686b7-0615-410f-b699-28d690866473" (UID: "e97686b7-0615-410f-b699-28d690866473"). InnerVolumeSpecName "kube-api-access-vf2bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:24:08.908490 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:08.908372    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e97686b7-0615-410f-b699-28d690866473" (UID: "e97686b7-0615-410f-b699-28d690866473"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:24:09.007409 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.007308    2587 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-webhook-cert\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.007409 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.007343    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97686b7-0615-410f-b699-28d690866473-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.007409 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.007361    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf2bx\" (UniqueName: \"kubernetes.io/projected/e97686b7-0615-410f-b699-28d690866473-kube-api-access-vf2bx\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:24:09.314358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.314263    2587 generic.go:356] "Generic (PLEG): container finished" podID="e97686b7-0615-410f-b699-28d690866473" containerID="1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095" exitCode=0
Sep 11 19:24:09.314358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.314302    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-86sgl"
Sep 11 19:24:09.314358 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.314341    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-86sgl" event={"ID":"e97686b7-0615-410f-b699-28d690866473","Type":"ContainerDied","Data":"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"}
Sep 11 19:24:09.314944 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.314403    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-86sgl" event={"ID":"e97686b7-0615-410f-b699-28d690866473","Type":"ContainerDied","Data":"4a74238044d0fd79556145d81f4df472e279835053a81b756baf1bc8e295e6a8"}
Sep 11 19:24:09.314944 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.314437    2587 scope.go:117] "RemoveContainer" containerID="1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"
Sep 11 19:24:09.327666 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.327637    2587 scope.go:117] "RemoveContainer" containerID="1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"
Sep 11 19:24:09.328039 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:24:09.328012    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095\": container with ID starting with 1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095 not found: ID does not exist" containerID="1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"
Sep 11 19:24:09.328101 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.328052    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095"} err="failed to get container status \"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095\": rpc error: code = NotFound desc = could not find container \"1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095\": container with ID starting with 1aef3522e9162481489a5b2dac7b0519a171c388114fae48f9604988ac912095 not found: ID does not exist"
Sep 11 19:24:09.339939 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.339905    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:24:09.344081 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.344049    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-674ff667f9-86sgl"]
Sep 11 19:24:09.995875 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:09.995842    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e97686b7-0615-410f-b699-28d690866473" path="/var/lib/kubelet/pods/e97686b7-0615-410f-b699-28d690866473/volumes"
Sep 11 19:24:10.125185 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.125151    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674ff667f9-7qqgn"]
Sep 11 19:24:10.125555 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.125543    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97686b7-0615-410f-b699-28d690866473" containerName="manager"
Sep 11 19:24:10.125625 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.125557    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97686b7-0615-410f-b699-28d690866473" containerName="manager"
Sep 11 19:24:10.125669 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.125652    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="e97686b7-0615-410f-b699-28d690866473" containerName="manager"
Sep 11 19:24:10.130127 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.130105    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.132870 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.132848    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 19:24:10.133007 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.132849    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mtdfh\""
Sep 11 19:24:10.133007 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.132849    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 19:24:10.133007 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.132849    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 19:24:10.138715 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.138684    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7qqgn"]
Sep 11 19:24:10.219553 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.219514    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-metrics-certs\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.219553 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.219554    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-webhook-cert\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.219795 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.219778    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ssx\" (UniqueName: \"kubernetes.io/projected/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-kube-api-access-t4ssx\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.320307 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.320214    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ssx\" (UniqueName: \"kubernetes.io/projected/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-kube-api-access-t4ssx\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.320307 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.320283    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-metrics-certs\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.320840 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.320313    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-webhook-cert\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.322930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.322906    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-webhook-cert\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.322930 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.322918    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-metrics-certs\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.328125 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.328103    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ssx\" (UniqueName: \"kubernetes.io/projected/d33364a2-ac0e-462a-b570-a3c9fd05e7cf-kube-api-access-t4ssx\") pod \"maas-controller-674ff667f9-7qqgn\" (UID: \"d33364a2-ac0e-462a-b570-a3c9fd05e7cf\") " pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.441495 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.441462    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:10.714619 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:10.714573    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674ff667f9-7qqgn"]
Sep 11 19:24:10.716432 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:24:10.716401    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33364a2_ac0e_462a_b570_a3c9fd05e7cf.slice/crio-3121321ab5388241fb763c170b612785f340215e330d65dbaf4a2f1087301fe5 WatchSource:0}: Error finding container 3121321ab5388241fb763c170b612785f340215e330d65dbaf4a2f1087301fe5: Status 404 returned error can't find the container with id 3121321ab5388241fb763c170b612785f340215e330d65dbaf4a2f1087301fe5
Sep 11 19:24:11.328435 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:11.328403    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7qqgn" event={"ID":"d33364a2-ac0e-462a-b570-a3c9fd05e7cf","Type":"ContainerStarted","Data":"c7d846e67fc83358abc0fc1ad04b5368744e848677713c6f24e9a6f9c0e1a19c"}
Sep 11 19:24:11.328913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:11.328494    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:11.328913 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:11.328517    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674ff667f9-7qqgn" event={"ID":"d33364a2-ac0e-462a-b570-a3c9fd05e7cf","Type":"ContainerStarted","Data":"3121321ab5388241fb763c170b612785f340215e330d65dbaf4a2f1087301fe5"}
Sep 11 19:24:11.345166 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:11.345105    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-674ff667f9-7qqgn" podStartSLOduration=0.932579559 podStartE2EDuration="1.345088467s" totalImagesPullingTime="412.508908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:11.344980228 +0000 UTC m=+2129.831904106" watchObservedRunningTime="2026-09-11 19:24:11.345088467 +0000 UTC m=+2129.832012345"
Sep 11 19:24:22.337342 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:22.337301    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-674ff667f9-7qqgn"
Sep 11 19:24:34.013169 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:34.013133    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:24:41.014934 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:41.014896    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:24:48.413179 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:48.413144    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:24:56.615225 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:24:56.615181    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:25:05.700472 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:25:05.700426    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:25:12.707826 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:25:12.707786    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:25:21.007378 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:25:21.007341    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:25:29.022395 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:25:29.022361    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:26:57.811740 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:26:57.811705    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:27:04.303850 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:27:04.303812    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:27:11.406489 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:27:11.406449    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:27:22.302565 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:27:22.302526    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:27:30.505139 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:27:30.505091    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:27:53.404150 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:27:53.404067    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:01.109035 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:01.108950    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:08.206637 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:08.206584    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:15.813117 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:15.813079    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:16.166674 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.166363    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"]
Sep 11 19:28:16.172535 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.172506    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.182027 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.181533    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"]
Sep 11 19:28:16.287344 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.287305    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3846b110-1641-472c-a6bb-0ef70205e063-openshift-service-ca\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.287551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.287364    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvgl\" (UniqueName: \"kubernetes.io/projected/3846b110-1641-472c-a6bb-0ef70205e063-kube-api-access-skvgl\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.287551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.287456    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-metrics-certs\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.287551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.287505    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-maas-api-tls\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.388814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.388771    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3846b110-1641-472c-a6bb-0ef70205e063-openshift-service-ca\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.388814 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.388821    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvgl\" (UniqueName: \"kubernetes.io/projected/3846b110-1641-472c-a6bb-0ef70205e063-kube-api-access-skvgl\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.389029 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.389002    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-metrics-certs\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.389101 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.389086    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-maas-api-tls\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.389514 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.389485    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3846b110-1641-472c-a6bb-0ef70205e063-openshift-service-ca\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.391571 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.391553    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-metrics-certs\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.391662 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.391622    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3846b110-1641-472c-a6bb-0ef70205e063-maas-api-tls\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.405655 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.405628    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvgl\" (UniqueName: \"kubernetes.io/projected/3846b110-1641-472c-a6bb-0ef70205e063-kube-api-access-skvgl\") pod \"maas-api-79c474dfdd-whqv8\" (UID: \"3846b110-1641-472c-a6bb-0ef70205e063\") " pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.486297 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.486258    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:16.763076 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:16.763044    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"]
Sep 11 19:28:16.764672 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:28:16.764636    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3846b110_1641_472c_a6bb_0ef70205e063.slice/crio-8b3c2e2b441e32d14512f8798cb1ddac204d740d37006b468c956deb248db4de WatchSource:0}: Error finding container 8b3c2e2b441e32d14512f8798cb1ddac204d740d37006b468c956deb248db4de: Status 404 returned error can't find the container with id 8b3c2e2b441e32d14512f8798cb1ddac204d740d37006b468c956deb248db4de
Sep 11 19:28:17.755530 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:17.755492    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8" event={"ID":"3846b110-1641-472c-a6bb-0ef70205e063","Type":"ContainerStarted","Data":"50ea1f1bb21307a67a5769bdebdfeacd9f0d2d6b14afd5c0227a758bd229f30b"}
Sep 11 19:28:17.756038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:17.755549    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8" event={"ID":"3846b110-1641-472c-a6bb-0ef70205e063","Type":"ContainerStarted","Data":"8b3c2e2b441e32d14512f8798cb1ddac204d740d37006b468c956deb248db4de"}
Sep 11 19:28:17.756038 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:17.755693    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:17.773607 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:17.773542    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8" podStartSLOduration=1.284059228 podStartE2EDuration="1.773526311s" totalImagesPullingTime="489.467083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:28:17.77032955 +0000 UTC m=+2376.257253428" watchObservedRunningTime="2026-09-11 19:28:17.773526311 +0000 UTC m=+2376.260450243"
Sep 11 19:28:23.504011 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:23.503970    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:23.767399 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:23.767315    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79c474dfdd-whqv8"
Sep 11 19:28:23.815504 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:23.815468    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 19:28:23.815735 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:23.815694    2587 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" podUID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" containerName="maas-api" containerID="cri-o://bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1" gracePeriod=30
Sep 11 19:28:25.068364 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.068338    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 19:28:25.174907 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.174879    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca\") pod \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") "
Sep 11 19:28:25.175108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.174979    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jq44\" (UniqueName: \"kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44\") pod \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") "
Sep 11 19:28:25.175108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.175051    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs\") pod \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") "
Sep 11 19:28:25.175108 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.175104    2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls\") pod \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\" (UID: \"83274355-6b9f-46df-b7c5-b2e5357b1ef4\") "
Sep 11 19:28:25.175342 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.175313    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83274355-6b9f-46df-b7c5-b2e5357b1ef4" (UID: "83274355-6b9f-46df-b7c5-b2e5357b1ef4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:28:25.175440 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.175418    2587 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83274355-6b9f-46df-b7c5-b2e5357b1ef4-openshift-service-ca\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:28:25.177295 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.177274    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83274355-6b9f-46df-b7c5-b2e5357b1ef4" (UID: "83274355-6b9f-46df-b7c5-b2e5357b1ef4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:28:25.177399 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.177341    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83274355-6b9f-46df-b7c5-b2e5357b1ef4" (UID: "83274355-6b9f-46df-b7c5-b2e5357b1ef4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:28:25.177458 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.177421    2587 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44" (OuterVolumeSpecName: "kube-api-access-7jq44") pod "83274355-6b9f-46df-b7c5-b2e5357b1ef4" (UID: "83274355-6b9f-46df-b7c5-b2e5357b1ef4"). InnerVolumeSpecName "kube-api-access-7jq44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:28:25.276828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.276787    2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jq44\" (UniqueName: \"kubernetes.io/projected/83274355-6b9f-46df-b7c5-b2e5357b1ef4-kube-api-access-7jq44\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:28:25.276828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.276819    2587 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-metrics-certs\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:28:25.276828 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.276828    2587 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83274355-6b9f-46df-b7c5-b2e5357b1ef4-maas-api-tls\") on node \"ip-10-0-134-233.ec2.internal\" DevicePath \"\""
Sep 11 19:28:25.807271 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.807238    2587 generic.go:356] "Generic (PLEG): container finished" podID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" containerID="bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1" exitCode=0
Sep 11 19:28:25.807441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.807293    2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"
Sep 11 19:28:25.807441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.807315    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" event={"ID":"83274355-6b9f-46df-b7c5-b2e5357b1ef4","Type":"ContainerDied","Data":"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"}
Sep 11 19:28:25.807441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.807371    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w" event={"ID":"83274355-6b9f-46df-b7c5-b2e5357b1ef4","Type":"ContainerDied","Data":"21110762926d8e10370481489718235ad5739582c969cabd1f189c7415e04d0c"}
Sep 11 19:28:25.807441 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.807396    2587 scope.go:117] "RemoveContainer" containerID="bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"
Sep 11 19:28:25.817211 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.817192    2587 scope.go:117] "RemoveContainer" containerID="bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"
Sep 11 19:28:25.817467 ip-10-0-134-233 kubenswrapper[2587]: E0911 19:28:25.817448    2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1\": container with ID starting with bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1 not found: ID does not exist" containerID="bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"
Sep 11 19:28:25.817510 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.817477    2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1"} err="failed to get container status \"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1\": rpc error: code = NotFound desc = could not find container \"bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1\": container with ID starting with bf954b7841664999fa73c6e1a4a184b6066ace668f403f53867fcc9f177955f1 not found: ID does not exist"
Sep 11 19:28:25.829238 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.829215    2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 19:28:25.831704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.831684    2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-79856dc5dd-jwn4w"]
Sep 11 19:28:25.996068 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:25.996037    2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" path="/var/lib/kubelet/pods/83274355-6b9f-46df-b7c5-b2e5357b1ef4/volumes"
Sep 11 19:28:30.434887 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:30.434850    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:36.008383 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:36.008346    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:42.909280 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:42.909184    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhcph"]
Sep 11 19:28:45.799161 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:45.799126    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74d98bd5cf-7b6tt_bdf8e8da-6ee3-436b-a417-81fda56bafef/authorino/0.log"
Sep 11 19:28:50.956687 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:50.956654    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nlrcn_f33f7e00-42dd-4f67-888f-b245a1857788/manager/0.log"
Sep 11 19:28:51.070818 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:51.070778    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kmdvj_39271a23-a8c8-48db-ad38-ca536a625322/manager/0.log"
Sep 11 19:28:51.187035 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:51.187003    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-674ff667f9-7qqgn_d33364a2-ac0e-462a-b570-a3c9fd05e7cf/manager/0.log"
Sep 11 19:28:51.778272 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:51.778239    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9988978f-ln6j9_c94907e8-54c5-442e-9337-30955a260d11/copy-manifests/0.log"
Sep 11 19:28:51.790551 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:51.790523    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9988978f-ln6j9_c94907e8-54c5-442e-9337-30955a260d11/manager/0.log"
Sep 11 19:28:52.236519 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:52.236471    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79c474dfdd-whqv8_3846b110-1641-472c-a6bb-0ef70205e063/maas-api/0.log"
Sep 11 19:28:53.303104 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.303071    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74d98bd5cf-7b6tt_bdf8e8da-6ee3-436b-a417-81fda56bafef/authorino/0.log"
Sep 11 19:28:53.424095 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.424054    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-4242g_3e6df157-8c1f-4cdb-b620-fa68cbac2fb0/manager/0.log"
Sep 11 19:28:53.534479 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.534442    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dnbqd_6cb3d983-9a45-4bff-aa78-6ae7d7d283e9/manager/0.log"
Sep 11 19:28:53.641842 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.641762    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dvflc_809a7737-1b92-47f2-9c76-c676ca0d8323/kuadrant-console-plugin/0.log"
Sep 11 19:28:53.866074 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.866047    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fhcph_f9d06e40-0b8a-4920-948e-0a2b4758f904/limitador/0.log"
Sep 11 19:28:53.977196 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:53.977169    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hvqvk_4d063ff1-28f6-4aab-86af-8ad361aa6e10/manager/0.log"
Sep 11 19:28:54.537547 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:54.537516    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5868776b49-8d8bb_1fa1af5a-ec6d-49c9-951b-cd412c18f26b/kube-auth-proxy/0.log"
Sep 11 19:28:54.752504 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:54.752445    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/1.log"
Sep 11 19:28:55.092172 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:55.092124    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f86cdcc6-86wzz_420d2003-c7b3-489e-bf79-9f37ba6a0526/router/0.log"
Sep 11 19:28:55.427059 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:55.427034    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nhll9_09b5dd3e-51db-44c4-92f6-4ec7998de8da/main/0.log"
Sep 11 19:28:55.865433 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:28:55.865342    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4pklb_f4ef3426-603d-4724-9730-33cd67beae31/main/0.log"
Sep 11 19:29:03.877502 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:03.877472    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k9lrz_6ae45f75-7e48-476d-aad6-d35a1948b728/global-pull-secret-syncer/0.log"
Sep 11 19:29:04.072377 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:04.072303    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjwj4_ca506917-ed36-4055-88e6-53f9f1e1ec40/konnectivity-agent/0.log"
Sep 11 19:29:04.115291 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:04.115267    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-233.ec2.internal_784c1f32afb3a32b6f40a782dfed06fe/haproxy/0.log"
Sep 11 19:29:08.932121 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:08.932087    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74d98bd5cf-7b6tt_bdf8e8da-6ee3-436b-a417-81fda56bafef/authorino/0.log"
Sep 11 19:29:08.962100 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:08.962049    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-4242g_3e6df157-8c1f-4cdb-b620-fa68cbac2fb0/manager/0.log"
Sep 11 19:29:08.993967 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:08.993937    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dnbqd_6cb3d983-9a45-4bff-aa78-6ae7d7d283e9/manager/0.log"
Sep 11 19:29:09.024730 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:09.024706    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dvflc_809a7737-1b92-47f2-9c76-c676ca0d8323/kuadrant-console-plugin/0.log"
Sep 11 19:29:09.109470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:09.109434    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fhcph_f9d06e40-0b8a-4920-948e-0a2b4758f904/limitador/0.log"
Sep 11 19:29:09.167759 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:09.167729    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hvqvk_4d063ff1-28f6-4aab-86af-8ad361aa6e10/manager/0.log"
Sep 11 19:29:10.610375 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.610322    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/alertmanager/0.log"
Sep 11 19:29:10.636203 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.636173    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/config-reloader/0.log"
Sep 11 19:29:10.658133 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.658102    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/kube-rbac-proxy-web/0.log"
Sep 11 19:29:10.692414 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.692382    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/kube-rbac-proxy/0.log"
Sep 11 19:29:10.714124 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.714097    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/kube-rbac-proxy-metric/0.log"
Sep 11 19:29:10.739704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.739681    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/prom-label-proxy/0.log"
Sep 11 19:29:10.762365 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:10.762347    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c70cbae5-bda0-408c-8f54-4fe8b3de8842/init-config-reloader/0.log"
Sep 11 19:29:11.099315 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.099270    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8l2q_3a080cb2-045a-48dc-9b47-c4486e06aeba/node-exporter/0.log"
Sep 11 19:29:11.125126 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.125101    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8l2q_3a080cb2-045a-48dc-9b47-c4486e06aeba/kube-rbac-proxy/0.log"
Sep 11 19:29:11.151331 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.151309    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8l2q_3a080cb2-045a-48dc-9b47-c4486e06aeba/init-textfile/0.log"
Sep 11 19:29:11.299491 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.299403    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bv87k_b98931c3-dd7d-4c54-8f37-fa3347ff41be/kube-rbac-proxy-main/0.log"
Sep 11 19:29:11.321485 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.321463    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bv87k_b98931c3-dd7d-4c54-8f37-fa3347ff41be/kube-rbac-proxy-self/0.log"
Sep 11 19:29:11.345119 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.345097    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-bv87k_b98931c3-dd7d-4c54-8f37-fa3347ff41be/openshift-state-metrics/0.log"
Sep 11 19:29:11.583057 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.582972    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-fzxfv_1f772db9-5456-4c6c-a304-88f0438e3684/prometheus-operator/0.log"
Sep 11 19:29:11.605451 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.605422    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-fzxfv_1f772db9-5456-4c6c-a304-88f0438e3684/kube-rbac-proxy/0.log"
Sep 11 19:29:11.661789 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.661761    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-778458fdf5-thjbs_34ab5457-0a74-451e-ad9f-fd24d906ea25/telemeter-client/0.log"
Sep 11 19:29:11.683454 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.683427    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-778458fdf5-thjbs_34ab5457-0a74-451e-ad9f-fd24d906ea25/reload/0.log"
Sep 11 19:29:11.704400 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:11.704374    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-778458fdf5-thjbs_34ab5457-0a74-451e-ad9f-fd24d906ea25/kube-rbac-proxy/0.log"
Sep 11 19:29:13.805809 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.805769    2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"]
Sep 11 19:29:13.806392 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.806244    2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" containerName="maas-api"
Sep 11 19:29:13.806392 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.806265    2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" containerName="maas-api"
Sep 11 19:29:13.806392 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.806371    2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="83274355-6b9f-46df-b7c5-b2e5357b1ef4" containerName="maas-api"
Sep 11 19:29:13.809393 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.809374    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.811568 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.811546    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fmxz\"/\"openshift-service-ca.crt\""
Sep 11 19:29:13.812094 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.812076    2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fmxz\"/\"kube-root-ca.crt\""
Sep 11 19:29:13.812191 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.812078    2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6fmxz\"/\"default-dockercfg-bb7j4\""
Sep 11 19:29:13.822191 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.822170    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"]
Sep 11 19:29:13.836062 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.836030    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-proc\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.836183 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.836122    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-sys\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.836248 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.836230    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-lib-modules\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.836301 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.836272    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkdkq\" (UniqueName: \"kubernetes.io/projected/2de95741-07b1-4584-922d-7a228b96f1a5-kube-api-access-gkdkq\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.836357 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.836308    2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-podres\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937686    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-lib-modules\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937720 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937723    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkdkq\" (UniqueName: \"kubernetes.io/projected/2de95741-07b1-4584-922d-7a228b96f1a5-kube-api-access-gkdkq\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937746    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-podres\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937778    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-proc\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937810    2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-sys\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937874    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-podres\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937912    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-sys\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937912    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-proc\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.937974 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.937872    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de95741-07b1-4584-922d-7a228b96f1a5-lib-modules\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:13.945471 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:13.945449    2587 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkdkq\" (UniqueName: \"kubernetes.io/projected/2de95741-07b1-4584-922d-7a228b96f1a5-kube-api-access-gkdkq\") pod \"perf-node-gather-daemonset-z5lqb\" (UID: \"2de95741-07b1-4584-922d-7a228b96f1a5\") " pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:14.119669 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:14.119562    2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:14.325704 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:14.325673    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69d9d8dffc-rc5fh_5653c9ff-bcfe-4c84-b807-fb5b2a7224ee/console/0.log"
Sep 11 19:29:14.362118 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:14.362070    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-7drvw_161a3d9d-ce52-4a30-910f-b9c59c44d9c9/download-server/0.log"
Sep 11 19:29:14.393578 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:14.393550    2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"]
Sep 11 19:29:14.395229 ip-10-0-134-233 kubenswrapper[2587]: W0911 19:29:14.395198    2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2de95741_07b1_4584_922d_7a228b96f1a5.slice/crio-c22636d3ab3d6feddd0985cde0f1aa59e43834536e814701d2dbcd113ac8e3a8 WatchSource:0}: Error finding container c22636d3ab3d6feddd0985cde0f1aa59e43834536e814701d2dbcd113ac8e3a8: Status 404 returned error can't find the container with id c22636d3ab3d6feddd0985cde0f1aa59e43834536e814701d2dbcd113ac8e3a8
Sep 11 19:29:15.092251 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:15.092217    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb" event={"ID":"2de95741-07b1-4584-922d-7a228b96f1a5","Type":"ContainerStarted","Data":"cca6cb73731d073b50323f91b3c59e6d78e95f3ff1546dba3e29d6f91d8c65e3"}
Sep 11 19:29:15.092670 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:15.092271    2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb" event={"ID":"2de95741-07b1-4584-922d-7a228b96f1a5","Type":"ContainerStarted","Data":"c22636d3ab3d6feddd0985cde0f1aa59e43834536e814701d2dbcd113ac8e3a8"}
Sep 11 19:29:15.092670 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:15.092323    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:15.108407 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:15.108362    2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb" podStartSLOduration=2.108346862 podStartE2EDuration="2.108346862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:15.106653175 +0000 UTC m=+2433.593577058" watchObservedRunningTime="2026-09-11 19:29:15.108346862 +0000 UTC m=+2433.595270740"
Sep 11 19:29:16.173961 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:16.173924    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h2p8r_1ba7a1dd-71f8-424c-8d60-fd43d6568a86/dns/0.log"
Sep 11 19:29:16.198995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:16.198939    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h2p8r_1ba7a1dd-71f8-424c-8d60-fd43d6568a86/kube-rbac-proxy/0.log"
Sep 11 19:29:16.294896 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:16.294864    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpwjw_24f987b3-d9b4-4f0d-a01e-e864320bb2a5/dns-node-resolver/0.log"
Sep 11 19:29:16.916010 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:16.915977    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74c95d5c6b-hvz96_bad574f9-e79a-4c5d-ab3c-fbcd9e2af60d/registry/0.log"
Sep 11 19:29:16.936173 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:16.936144    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gft9g_a7411469-29bb-4036-8a5b-71a987dfba94/node-ca/0.log"
Sep 11 19:29:18.450490 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:18.450458    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5868776b49-8d8bb_1fa1af5a-ec6d-49c9-951b-cd412c18f26b/kube-auth-proxy/0.log"
Sep 11 19:29:18.510062 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:18.510023    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/0.log"
Sep 11 19:29:18.512470 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:18.512448    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/1.log"
Sep 11 19:29:18.602357 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:18.602330    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f86cdcc6-86wzz_420d2003-c7b3-489e-bf79-9f37ba6a0526/router/0.log"
Sep 11 19:29:19.503207 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:19.503175    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4wsk_3d65ea04-b065-4472-8239-bdf50ebbd480/serve-healthcheck-canary/0.log"
Sep 11 19:29:20.063234 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:20.063202    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hmnx_8fc704cd-a5dd-47c1-8f3d-992cbfd00243/kube-rbac-proxy/0.log"
Sep 11 19:29:20.084403 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:20.084377    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hmnx_8fc704cd-a5dd-47c1-8f3d-992cbfd00243/exporter/0.log"
Sep 11 19:29:20.106771 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:20.106740    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hmnx_8fc704cd-a5dd-47c1-8f3d-992cbfd00243/extractor/0.log"
Sep 11 19:29:21.107660 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:21.107633    2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6fmxz/perf-node-gather-daemonset-z5lqb"
Sep 11 19:29:22.443956 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:22.443931    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nlrcn_f33f7e00-42dd-4f67-888f-b245a1857788/manager/0.log"
Sep 11 19:29:22.697995 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:22.697964    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kmdvj_39271a23-a8c8-48db-ad38-ca536a625322/manager/0.log"
Sep 11 19:29:22.757161 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:22.757137    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-674ff667f9-7qqgn_d33364a2-ac0e-462a-b570-a3c9fd05e7cf/manager/0.log"
Sep 11 19:29:23.074660 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:23.074556    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9988978f-ln6j9_c94907e8-54c5-442e-9337-30955a260d11/manager/0.log"
Sep 11 19:29:23.093750 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:23.093724    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9988978f-ln6j9_c94907e8-54c5-442e-9337-30955a260d11/copy-manifests/0.log"
Sep 11 19:29:24.787239 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:24.787213    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5868776b49-8d8bb_1fa1af5a-ec6d-49c9-951b-cd412c18f26b/kube-auth-proxy/0.log"
Sep 11 19:29:24.838878 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:24.838846    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/0.log"
Sep 11 19:29:24.842415 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:24.842386    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/1.log"
Sep 11 19:29:24.911573 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:24.911529    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f86cdcc6-86wzz_420d2003-c7b3-489e-bf79-9f37ba6a0526/router/0.log"
Sep 11 19:29:26.933531 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:26.933500    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5868776b49-8d8bb_1fa1af5a-ec6d-49c9-951b-cd412c18f26b/kube-auth-proxy/0.log"
Sep 11 19:29:26.973747 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:26.973703    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/0.log"
Sep 11 19:29:26.978068 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:26.978044    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-8thv6_b00b2084-00b6-490f-b5a4-35471d995f5c/istio-proxy/1.log"
Sep 11 19:29:27.042282 ip-10-0-134-233 kubenswrapper[2587]: I0911 19:29:27.042255    2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f86cdcc6-86wzz_420d2003-c7b3-489e-bf79-9f37ba6a0526/router/0.log"